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INTRODUCTORY SECTION 



ABSTRACT 



The Institute for Developmental Studies (IDS) program was es- 
tablished in 1958, and represented an attempt to study the inter- 
play of environment on psychological development, and to evolve and 
develop an enriched and stimulating school curriculum for socielly 
disadvantaged children. Over the years, the IDS program has evolved 
into a comprehensive five year enrichment curriculum', running from 
the prekindergarten year through the third grade. 

The academic progress of both Institute and control children 
was monitored over the five year period by administering both 
standardized and Institute-developed tests and observational proce- 
dures. IDS experimental E children and those in the control groups 
were tested with a wide battery of measures of ability and achieve- 
ment. Longitudinal evaluative information was obtained through the 
administration of the Stanford-Binet Intelligence Scale (Form L-M) ; 
the Peabody Picture vocabulary Test ; the Illinois Test of Psycho- 
linguistic Abilities; the Lorge-Thorndike Intelligence Tests and 
the Metropolitan Achievement Tests, 

The findings reviewed in this report show a positive change for 
(Children who experienced five years of enrichment in the Institute 
for Developmental Studies program, as compared with a control group 
of children who were not in the enrichment program. Experimental 
children performed better cm a number of neasures of ability and 
achievement, and appeared to maintain much of their early enrichment 
advantage over their controls. 

The relatively high performance of the E children on the Stan- 
ford - Binet, Lorge Thorndike, and the Peabody Pi'" are V s -y 

Test, as well as the grac''" e(rv' - ^cores on Metropolitan Word 

Knowledge, Reading, and Problem Solving and Concepts subtests, under- 
sccre the effectiveness of those elements of the curriculum that are 
both cognitively arid linguistically based. 

In cont:'.;..st, one can see that on those measures where rote 
memory or mechaniosl operations are extremely important, (where tht: 
al;ility to so_ve problems is not tapped) , the children did not score 
significantly hi^(:^r than their controls. 

The evidence we have just reviewed provides support for the 
conclusion rhat particularly in the preschool years, the IDS experi- 
ence was successful for the cUiildren from depressed areas can and cii 
learn. 
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BACKGROUND 



The Institute for Developmental Studies was founded in 
1958 at the New York Medical College, and in 1966 became part 
of New York University, where it continues as an interdisci- 
plinary unit within the School of Education. The Institute 
is engaged in a long-range investigation of the developmental, 
psychological, and social determinants, of learning and intel- 
ligence, with particular emphasis on the role of envirorjnental 
influences. The many Institute projects constitute a mutually 
reinforcing cycle of basic and applied research, demonstration 
enrichment programs, and their evaluation with both standardized 
and Institute-devised and adapted tests. 

The Institute also has been engaged in an ongoing training 
program for the teachers in its own demonstration enrichment 
classrooms, as well as for teachers, school administrators, and 
supervisors in systems in New York City and other parts of the 
coratry. In addition, IDS staff members have worked closely 
with parents of children in the enrichment program, and with 
community members in the various areas that the program has 
operated in. 

The Institute’s work has been guided by a number of theore- 
tical formulations about the nature of himian development and 
learning (such as those of Piaget, Lewin, Skinner, Hunt, and 
others) , as well as by the results of countless research studies 
that deal with the importance of ear'’.y stimulation and with the 
effect*' that social class and race membership have on members 
of Amea-^can society. 

Studies, using both human and animal subjects, have long 
shown that aspects of an organism^ s early environment and, 
moreover, enrichment of that early environment, are related 
to the organism’s future development. (See for exiimple Skeels,et al, 
1938; Stoddard and Wellman, 19M-0; Stoddard, 19M-6; Skeels, 1965) 

Furthermore, numerous research studies have related social 
class and race membership (with most of the variance being 
associated with social class differences) to such interrelated 
areas as: linguistic development (e.g., Templin, 1957; Bernstein, 

1960; Deutsch, 1960; Deutsch, 1965; Bloom et.al, 1965; Whiteman 
and Deutsch, 1967); conceptual development (e.g., Hmit, 1961; 

Deutsch, 1963); and perceptual development (e.g., Reissman, 

1962; C. Deutsch, 196 M-) . 

Drawing from the theoretical and research issues raised 
in many of the studies cited above (which have been cited 
merely to exemplify a rich body of theory and research findings 
in these as well as other related fields) , the Institute staff 
sought to establish and implement an enriched school curriculum, 
one which would carry socio-economically disadvantaged children 





from the prekindergarten year through the third grade . A de~ 
tailed description of this curriculum, and an abstract of its 
most salient characteristics, is provided in the body of this 
report. 

The academic progress of children in the enrichment pro- 
gram (also referred to in this text as the experimental group) 
was evaluated at regular intervals as they progressed 
through the five year enrichment period. The children s per- 
formance on a wide variety of tests of ability and achievement 
has been assessed and compared with the performance of children 
in several control groups. 



The present report is concerned with the presentation and 
interpretation of the results of this evaluation; and, while 
we will describe the enrichment curriculum itself, the focus 
of this document is on the analysis of the evaluation data 
and the formulation of their implications. 

Readers from the U.S. Office of Education are particularly ^ 
referred to nages i -fi end which cover the activities specifi- 

cally covered under contract #0E - 5 - 1 0 - Q M-5 . 



methods 



Curriculum Abstract — Summary Description cf the 

Intervening Variable 

The IDS curriculum was designed to begin at a basic level and 
to emphasize those areas which have been found to be most operative 
in later learning; these included the cognitive areas of la gu g , 
perception, and concept formation, as well as the affective area 
of self-concept. 

The overall aim of the experimental progr^ was to enable 
children to reach levels of cognitive functioning which generally 
have been considered necessary for successful school experienc . 

Moreover, the IDS program was designed to help children acquire a 
degree of proficiency with academic skills, some independence 
learners, and feelings of confider-e as learners. 

To achieve these overall aims, several basic approaches were 
developed and used throughout the program. These persisted ^ 
throughout the expansion of the program, as new grades were » 
and as the original curriculum was supplemented. Despite the con- 
??nuoL e^oluSon of the progr™ and the dyn^ie ^^ndl- 

ous other factors (e.g. , -developing curricula, 
vidual teachers, changing needs of particular 

social change in the community, uncertainties of funding) , th 
methods were consistently applied. 

One of the important aspects of the IDS program was the care that 
is taken to make the materials and tasks appropriate to each ^ 

development level. The individualizing of 

from this care was a method that pervaded each step of the entire 
program. The materials, curriculum, physical arrangement of the 
room and program of assessing individual children s strengths and 
w^^kneSsL^weL all designed to meet the needs of chxldren who were, 
bv and large, organized in small instructional groups. In accord 
aLrwiirlh4 philosophy of in^-idualized instructxon no ^Trxngent 
goals were set for each grade level; the child was f 

at his own pace, in accordance with his own needs and abilities. 

A second characteristic, common to all phases of the IDS program, 
was the recurrence of specific tasks throughout the classroom and 
thLugLut many of the Ltivities of the day. ^’^e task of size dis- 
crimination, for example, recurred in such materials and acti t 
as* the three sizes of jars available for painting, the van 

nf blocks that had to be put back appropriately on the shelves 
^SnisLLlon at Shcle time or lunch ti:ne, the various gmnes avail- 
able for quiet time, etc. 

To facilitate its overall aims, a unique staffing pattern was 
developed by IDS; such a pattern persisted during the , 

thl prEgram'^and existed on all grade levels. The 

of tochers, assistant teachers, curriculum specialists, and supervisor , 
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whose work was coordinated by a curriculum director. Both assistants 
and teachers engaged in pedagogical activities in the IDS classroom; 
assistants were trained and expected to perform actual teaching, 
rather than merely custodial, functions. Curriculum specialists, ^ 
and outside resource people worked closely with the teachers, assist- 
ants and supervisors in a program of inservice training. 

In addition, the IDS supervisory pattern was characterized by a 
small number of teachers assigned to each supervisor. Generally, 
each supervisor was I’esponsible for the staff of no more than six 
classrooms. For the most part, supervisors acted in a supportive 
manner and demonstrated their suggestions by actually working with 
children and introducing materials into the classrooms itself. In 
addition to their work with teachers, IDS supervisors periodically 
met with each other to plan their activities and discuss common problems. 

h fourth fundamental and persisting aspect of the IDS program 
was the emphasis that was placed on inservice training of all super- 
visory and teaching staff. Through a variety of activities fe.g., 
workshops, conferences), the performance of teachers and Pupls 
could be discussed. Such activities not only provided feedback on 
the appropriateness of the current curriculum, but also allowed for 
the introduction and exploration of new ideas, methods, and materials. 
Thus, staff and program development were built into the design of ^ 
the IDS program; they helped to insure the maintenance of a dynamic 
educational environment for the teachers and supervisors, as well as 
for the children. 

A final basic aspect of the IDS program, to be mentioned only 
briefly here, was the commitment to an active and ongoing progr^ 
of parent involvement. The IDS staff continually stressed the 
portance of such involvement to the academic success of the children, 
as well as to the efficacy of the enrichment program. 

In the IDS program, the child^s activities were defined so that 
they began with the most basic skill level, and then they proceeded 
sequentially through succeeding levels, with increasing complexity. 

The steps leading from one level to the next were designed to pro- 
vide a manageable challenge for the child. Activities were paced 
for each child so that he could proceed from element to element 
at the rate most comfortable and reinforcing for him. 

A nuiTiber of techniques and special materials were used to help 
to accomplish IDS goals. Only a few examples, from among the m^y 
materials and techniques that have been developed and used by IDS 
will be cited here. 

The Language Master is one such learning device; it was used 
in a number of ways to build vocabulary and enhance the understanding 
of basic concepts. With this recording device, a taped voice iden- 
tified an object or concept which was represented by a pic-^re on a 
cord. The cord moved through the machine exposing that object or 
concept as the taped voice stated its -name. Finally, the child 



identified the object and recorded his own voice, and then compared 
his speech pattern and sentence structure with that of the taped 
Voice- 



One of the games which was developed at IDS is Language Lotco., 
This game is similar to standard games of Lotto, but moreover, it 
can be played at differnet linguistic and conceptual level, ranging 
from nonverbal matching to verbal matching of pictures , requiring 
increasingly complex cognitive skills. 

Teaching strategies, such as the scheduling of a Quiet Work 
Time within the preschool day, also were designed to meet IDS ^ 
program goals. Duriiig this time, all noise-producing activities 
were suspended and children worked, with such materials as puzzles , 
individual learning games, etc. During this time, teachers were 
able to work on a one-to-one basis with children, and to guide 
their individual and small group activities. 

IDS children also worked with published curricula (such as the 
Stern and Sullivan reading programs and the AAAS process approach 
science nialrcnials) is well as wiirh. a plexlioi'a of Institnite- dev eloped 
learning games and Individualized learning materials. 

This description is a very brief summary of the IDS curriculum 
and has been provided for those readers who need only an overview 
of curriculum methodology and orientation in order to imderstand the 
xn-t6rpretation of the evaluation data pressnted in this report. A 
more detailed description of the longitudinal curriculum, enrichment 
and of some of the IDS materials, follows. 



Curriculum Description 



Introduction 

The following is a fuller description of the major components 
of the five year experimental program. The Curriculum Abstract 
presented was prepared in collaboration with the social scientists 
and curriculum specialists who have been involved with, and have 
been continuously observing, the evolution of the enrichment 
program. However, the statement suffers from the limitations in- 
herent in a summary, as opposed to a full description. It should 
also be made clear that the curriculum was truly an evolving one: 
many more elements were tried, modified, incorporated or discarded 
than can be reported in this brief statement. 

Since the curriculum was designed to be continuously evolving 
some of what is reported here has undergone subsequent modification. 
The program has been appropriately expanded and deleted wherever it 
was indicated by the reactions of teachers and students. However, 
for the most part, this outline represents the experimental treat- 
ment of the subjects whose performance is reflected in the test 
scores that are reported later in this monograph. 

An overall description of the prekindergarten and kindergarten 
programs will be given first. After that, each curriculum content 
area, together with relevant examples of materials, will be described 
for the entire five year time span (from prekindergarten through 
third grade) . 

Prekindergarten and Kindergarten program 

This portion of the IDS program is its oldest and most deve- 
loped part. Prel indergarten classes began for Wave I in January, 

1963; kindergarten classes were added in the fall of that year. 

One of the most important assumptions underlying the original 
preschool program V7as the idea that an orderly and sequential 
presentation of stimulie is extremely important to the development 
of young children. This seqtiential presentation generally has been 
thought to be requisite for full perceptual and cognitive development. 
Based on this assumption, the physical arrangement of the experimental 
classroom was designed to provide an ordered arrangement of stiinuli; 
opportunities for learning experiences were built into the arrangement 
of materials and organization of the classroom. 
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The preschool room was divided into clearly defined 
areas, each representing a learning center of the classroom: 
doll corner, library corner, quiet work area, block corner, 
listening center, etc. Non-verbal cues were proved in 
many of these areas to promote activity and learning. For 
example, colored adhesive plastic film was cut to match the 
size and shape of each type of block. This film was then 
mounted on the shelves where the blocks were stored, and 
served both to indicate how the blocks were stacked on the 
shelves and also to provide a visual matching experience 
for the children when they put the blocks away. 

Non-verbal cues also helped to indicate the type of 
behavior that was appropriate in a particular area at a 
particular time. For example, when the children were 
working with blocks, a rug was laid down in a corner re- 
served for block work. This minimized the distracting 
noise that was associated with block building and also 
indicated the appropriate activity for that area. For 
example, when the rug was rolled back, the area was used 
for another activity. In time a child was able, without 
specific instructions, to judge the appropriate time and 
place for an activity such as block building. In this 
manner, the rug, plastic film, and many other such non- 
verbal cues became meaningful substitutss for specific 
verbal instructions. 



The physical arrangement of materials in the IDS class- 
room also helped to promote learning activities. Materials 
were arranged with regard to common attributes of function 
and with a view to facilitating problem solving with respect 
to size, shape, texture, color, and other discriminable 
attributes. Materials were stored in clear plastic boxes, 
so that a child would easily take equipment for himself 
and replace it in the appropriate spot when he was finished. 



All of the materials required to do a specific task 
were stored together: e.g., the paint, paper, brushes, 

watGr. apron, and tha oth.Gr matGrials nGGdGd for 
were placed near each other. This encouraged a child to 
engage in and internalize a sequence of specific actions 
which were related to each other and to some final goal 
or task. For example, the sequence for painting might ue; 
first putting on an apron, then filling the water jar, 
thGn opGning thG jars of paint, than dipping thG rus , 
then painting, then cleaning the brush, and so forth. 

Children could modify the sequence and procedures as appre- 
oriate or as they choose, but storing all the components 
together was intended to- facilitate developmental goal-related 

sequences in behavior. Generally speaking, the children 
seemed to need a degree of organization if they were to 
master a task and be able to handle the increased complexity 



in any activity which resulted from the introduction of 
new elements. In addition, sequential patterns of behavior 
could be repeatedly utilized, as they helped in evolving 
sense of order and procedure that could be applied to new 
and changing situations. 

This can also be seen through the child’s use of the ^ 
Letter Form Board (a piece of equipment developed at IDS) . 
The Board consists of two rectangular panels that are 
joined by a hinge at the too that permits it to stand like 
a two-sided easel. Each panel consists of letter-shaped 
slots into which fit individual letter-shaped pieces. One 
of the panels holds a lowercase alphabet, and the other an 
uppercase one. There is room for ':wo replicas of the same 
letter in each slot. The Boarc^ is designed that letter 
pieces of similar outline cannal: be interchanged in their 
respective slots. That is, the i:ap3tal P will not fiu In 
the B, the C will not fit in the 0 slot, etc. 

A child can use the Letter For'ri Board for a number of 
different purposes and in a variety of ways, some of which 
are described in the Reading and Language Arts section^ 
below. However, no matter what the approach or objective, 
the child can develop a certain sequence of behaviors, 
which he can repeat, and perhaps later modify, when he 
works with the Letter Form Board. For example, he might 
follow a sequence such as: 

1, remove the plastic strip covering the letters he 
is to work with; 

2, remove all the letters that are exposed, using a 
"letter spoon" to take them out of their slots; 

3, classify the letters in some way (e.g., group 
pairs of the same letters together) ; 

M-. match the letters to the slot, following a left- 
to-right progression; 

5. repeat this procedure with each successive row. 

A sense of sequence and procedure was enhanced by 
arranging the schedule of activities into specific but 
flexible time blocks; these activities occurred regularly 
from day to day, or from week to week. Preschool aays, 
for example, were divided into recurring activity sequences 
such as: quiet work time, circle time, library time, etc. 

Emphasis on routines and procedures was one of the 
primary features of the IDS curriculum during the first 
few weeks of prekindergarten. Another factor, common to 
the entire curriculum but particularly stressed at this 



1. This Board is now commercially available from Houghton 
Mifflin Co. 
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beginning time, was the appropriate increase and decrease 
of the amount of material available for children to work with. 
When a child entered an IDS prekindergarten for the first time, 
he walked into a classroom containing a minimal amount of care- 
fully placed materials: limited auxiliary e< 3 iiipment for the 

block corner^ a limited number of blocks ; a limited amount of 
audio-visual equipment; few puzzles; few games, etc. The 
room was not overburdened with stimulating equipment. Each 
item Was placed so that it could be seen ‘ its entirety; a child 
was given the opporcunity to appreciate the c^ji iect’s qualities 
of length, depth, color, shape, etc., withoi t fru. distraction 
of many other materials placed nearby,. The amoiint 
of material available increased throughout fee yi'oar t. corre- 
spond to the child’s increasing ability to aio^orb nev stimiili. 

During the first week or two of pr ekinde-rgiiten , children 
were ’’phased into” the program. The number oi: a -:ildrsa present 
in the classroom, increased each day, and the amo/nt 0:1 time 
each child spent at school increased progressively. Tius, the 
child was not overwhelmed by a large group of ci!i._dren to cope 
with immediately, or by what for him would be s .eng time 
period full of new experiences. Instead, he ;,'a. expossed to 
the classroom in small stages and given the oppe rtunity to 
take in new stimuli at his ovm pace and to mac- rer what was 
planned to be a comprehensive environment. 

The phasing in of children, as well as the availability 
of two adults in each room, facilitated the individualization 
of instruction, one of the most critical aspects of the entire 
program. During the early part of prekindergarten, teachers 
wereable to carry out fairly extensive diagnostic evaluations 
to assess the strengths and weaknesses of individual children, 
as well as of the group as a whole. Children could easily be 
taught what was available in the room; how to approach, work 
with, and handle equipment; where materials belonged so that 
they could be returned, etc. From the start, the child was 
shown how to work Independently with the materials and equip- 
ment, and encouraged to function as an effective and confident 
learner in his classroom. 

After careful assessment was made of each child’s level 
of conceptual development, activities were planned which were 
designed to further growth in this area. Such activities 
were interwoven throughout the entire preschool program: in 

play with blocks, clay, paints, and other materials; in the 
use of specific language and mathematics games and manipula- 
tive materials; in music time and snack time; in cooking 
projects and in taking trips; in creative dramatics; and in 
a plethora of other experiences that constituted a rich early 
childhood program. 
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One of the most important parts of the preschool pro^am 
was the Quiet Work Time. This time (usually during the first 
hour of the day) was designed to give the child a period of _ 
sustained exposure to learning games and other quiet activities 
that emphasized cognitive development and skill mastery. 
Immediately on entering the classroom, the children began 
working with such materials as Language Lotto, puzzles, soi-L— ig 
games, magnetized letters, small plastic linking blocks, color 
cones and size cones, and the like. These games were progres- 
sively modified as the child developed greater skill in per 
ceptual and conceptual areas. During Quiet Work Time, all 
games and activities which led to noise and distraction (such 
as block building) were excluded. The teachers were free to 
work with individual children or with small groups j they could 
introduce new materials, led children to more complex use of 
current material, and planned for their individual and group 
needs. 

Throughout the Institute curriculum a main enphasis was 
placed on helping each child to develop an image of himself as 

both a competent and a worthwhile human being. His thoughts 

and opinions were accepted, or carefully questioned; his 
individual talents and needs were recognized and built upon. 

At the preschool level, efforts in this area were made 
to help the child develop an understanding of himself as a 
unique being. A camera was a standard piece of classroom 
equipment and was used to take pictures of children at 

different times during the year. These pictures could be 

found, for example, on each of the children's cubbies, along 
v^ith a written label of the chi3_d*s name. A special, point 
was made to greet each child by name and incorporate the 
children’s names in a variety of songs, games, and other 
activities during the day, A full-length mirror was placed 
in a doll corner so that a child could see what he looked 
like. (For many children, this was the first time they saw 
all of themselves — from head to toe.) Creative dramatics 
was used as a technique to help children gain insight into 
their own feelings and the feelings of others. This curricu- 
lum area gave the child the opportunity to ’try on’ and 
elaborate different roles (as well as to develop language 
and conceptual skills) . 

One other way in which an effort was made to help a 
child to develop a positive self-concept was by arranging 
tasks into smaller units which he could easily master, and 
thus build a series of small successes that would help him 
to develop confidence in his own ability. For example, if 
a teacher held up a red circle and asked, ’’What is this?” 
there might be a variety of reasons for a child’s inability 
to answer: he may not have understood the type of answer 



required, he may not have the specific iangua.ge necessary to 
answer the question, or he may not have the conceptual ability 
to answer the question. The teacher could si^divide the task 
and could provide meaningful clues and associations so that 
the child could successfully answer the question on some level. 

For example, the teacher might have asked, "Is this a red 
circle or a green circle?" thus providing the specific 
language necessary for answering the original question and 
defining the task in simple color terms. Or, the teacher 
might have placed the red circle on a piece of red paper 
and asked, "Is this the same color or a different color? 
thus further reducing the task to one of its more elemer.uary 
components , 

Such questions were used to adapt the total task so thau 
it consisted of a series of small subtasks, each of which a 
child could handle. Such subdividing was part of the commit- 
ment to finding an appropriate level of complexity for each 
individual child and was important to the successfuJ- individu- 
alizing of instruction. It should be stressed that the sub- 
division of whole tasks must be tailored to the level of 
ability of each child: a series of steps that may have been 

appropriate subdivision of a task for one child may have provided 
too much or too little challenge for another. The child was to 
feel that each step represented a real accomplishment for him, 
not that it was merely a reflection of the teacher’s desire 
to bolster his self-confidence. 

Not all the activities discussed above occurred each day 
in the preschool classrooms; the intensity of exposure to, 
and emphasis placed on, each of these activities was adapted 
to meet the current needs of the children. Generally, however, 
one can say that the IDS preschool day was divided into time 
blocks of: breakfast time^; quiet work time; circle time; 

free play time; informal and formal book and story times; an 
active time of rhythms, games, or outdoor play; and lunch time. 

Lunch time was structured to provide maximum opportunity 
for social interaction. Teachers and students sat together 
in "dining room" style so that conversation could easily take 
place between those sitting opposite each other, as well as 
those sitting next to each other. The emphasis place ^ on e 
identity of each individual was implemented here by giving 
each child his own place, with his own colorful plastic place 
mat and set of utensils. Continuity in the development of _ 
cognitive skills, begun during the day, was maintained during 
the lunch time. In one kindergarten class, for example, a 



2. This practice resulted from recognition of the importance of 
nutrition early in the day and the fact that many children in 
the program were not given breakfast at home. 
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teacher set .p a model for the children to follow in setting 
out each place; this model re-emphasized sequences and left- 
to-right progression by ha^^ing them first set the napkin and 
fork on the ^ -?t and then the spoon on the right. 

Each IDS teacher was given a great deal of latitude in 
adapting these broad curriculum outlines to meet the iiadividual 
needs of her class. Daily logs prepared by several pr ikinder- 
garten and kindergarten teachers are included in the appendix 
to this report. They give more specific information about 
the acti-vities of preschool days. (See Appendix II) 

The greatest progress in curriculum development by IDS 
was at the prekindergarten and kindergarten levels. In each 
of these programs , time was allotted for regular consultations 
betwen teachers and supervisors; time was made available to 
the teachers so that they could be involved with curriculum 
development. It was possible to do this within the regular 
work schedule of prekindergarten and kindergarten teachers 
because classes were conducted only during the morning, 
leaving the working afternoon free for these training and 
development activities. This arrangement, it was felt, 
greatly enhanced the evolution of the program. 

The above discussion has been concerned primarily with . 
the Institute’s prekindergarten and kindergarten programs. In 
the fall of 196M-, the work was extended to include a grades pro- 
gram, as the first wave of IDS children had reached first grade. 
In general, the structure and underlying philosophy of the pre- 
school program was maintained in the design and operation of 
the grades curricula (e.g., individualization of instruction, 
staffing patterns, parent program, etc.). The curriculum that 
was developed for the grades elaborated on those areas empha- 
sized in the preschool programs, and the curriculum was ^ 
designed to help children reach higher levels of cognitive 
functioning and greater skill mastery. In developing the 
grades curriculum, the Institute’s staff experimented with new 
materials and teaching methods, modified existing curricula, 
and developed materials and approaches of their own. As less 
overall time was available for it, curriculum development in 
the grades was not as extensive as that noted for the preschool 
segment of the IDS program. Nevertheless, the grades program 
evolved as a relatively cohesive entity, which will be described 
in the context of the various curriculum components extending 
from prekindergarten through the third grade. 

Reading and Language Arts - Prekindergarten through the 
Third Grade 

Starting with the nursery year and continuing for the four 
subsequent years of the Institute’s program, efforts were made 
to help the child develop his skill with language and to begin 
the teaching of reading. In this regard, several of the tech- 



niqiaes that ?.re used in the traditional nursery school were 
also employed in the Institute program ^e*g*j oral storytelling, 
trips, music, discussions). It is, however, the ways in which 
these activities were used in the IDS program that should be 
described. 

A trip to the zoo, to take just one exairple, is replete 
with opportunities to continue the development of concepts, 
some of which have already been introduced in the classroom. 

In songs, discussions, and other activities befor'^, after, 
and during a trip, children were involved in using such concepts 
as size differences (small and large animals) ; color differences 
(yellow giraffes and white polar bears) ; form differences (two 
legged and four legged animals) ; texture differences (furry and 
smooth skinned animals); etc. 

In addition to such activities, a wide variety of materials 
was constructed by IDS staff and other materials and games which 
were generally av&ilable were modified or adapted. The ^’^lotto^* 
principle was adapted in a series of language games „ for example. 
They were used to help foster both conceptual and language 
development and were played by children on differing conceptual 
levels as well as by those with varying degrees of linguistic 
proficiency. 

To play Language Lotto, each child is given a board with 
pictures on it. The player must determine on each card suc- 
cessively held up by a caller whether there is a match to one 
of the pictures on his board. 

Each game in the series has three possible response levels. 
The first level is that of simple non-verbal matching: the 

child merely indicates by raising his hand that he has matched 
the card to a picture on his board. The second level can be 
described as a receptive -language stage, in that the caller 
describes the card, but doesn^t show it to the players and 
the child must match the card to the picture on his board 
without the aid of visual cues, using only the caller ^s verbal 
description. The third level is a descriptive language stage: 
the caller takes a card from the completed board, and the 
player has to describe the picture that is left exposed on 
the board. 

Each of the separate games in the Language Lotto series 
deals with a different level of language ability and with a 
different type of concept or relationship. For example, the 
first game involves the recognition of simple objects, many 
of which are commonly found around the classroom. The second 



3. One series of such games is now commercially available as 
"Language Lotto" by L.G. Gotkin. 



game deals both with prepositions and with positional concepts 
(e.g., matching pictures and cards of a man lander a chair, 
next to a chair, on a chair, etc.) • Other games involve the 
use of verbs (action cards) ; conjunctions (the boy and the 
girl); singular and plural (boy, boys); etc. The most advanced 
game in the series involves the abstraction of particular 
relationships (e.g., matching a hand with a glove that fits 
on it) . 

These games exemplify a type of activity that is suitable 
for use by several children whose levels of conceptual and 
linguistic development may vary. A teacher can work with 
several children of differing abilities at the same time by 
asking different questions and requiring different responses 
of each child. Moreover, children of differing levels of 
mastery can work together as a small independent group with- 
out the direct guidance of the teacher. One child may be 
appointed to act as "teacher" and work with other children 
who are perhaps not as efficient in their utilization of 
skills. The child who plays the role of teacher is given the 
opportunity to practice the language pattern of the teacher 
as set by her model when she was working directly with the 
children. The use of these games is therefore consistent 
with the overall approach to education that is operative 
throughout the IDS program; individualizing instruction, 
teaching in small groups, and promoting independent behavior. 

The Listening Center is a major device that has been used 
in the~Institute classes in order to reinforce auto-instruc- 
tional and small group learning activities. The Listening 
Center has become an integral part of the IDS language curricu- 
lum from prekindergarten to third grade. The actual center is 
a semi-partitioned area of the classroom containing a tape 
recorder and several sets of ear phones. As many as six 
children can use the center at the same time; each child works 
individually with his own set of ear phones, away from the 
distraction of classroom noises. Special tapes are recorded 
by Institute teachers, supervisors, and curriculum specialists. 

By way of introduction to the tape recorder and how it 
works, children recorded their own voices and played back the 
sounds that they produced themselves. This technique, of 
having the children record and listen to their own voices, 
was continued at a later point in the IDS grades program in 
language development. In addition to stimulating language, 
it reflected the attempt to assist the child in constructing 
a total image of himself. 

The Listening Center was introduced in prekindergarten. 
The first tapes presented to the child wure prepared by his 
own familiar classroom teacher, in order to provide him with 
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a speech model and facilitate his attending to the previously 
strange equipment. At the early levels, the teachers recorded 
story tapes for the child to listen to; the tapes also included 
questions and blank time for the child to respond to the 
questions. At more advanced levels, particularly in the grades, 
the tapes were used as part of the reading and math curricula 
(to give programmed lessons) as well as part of the evaluation 
program. 

The IDS program in the development of general language 
skills was supplemented by early efforts to begin the process 
of teaching reading. In addition to the type of prereac ng 
activities that were stressed in other preschool programs 
(such as manipulation of shapes in working with collages, 
puzzles, games, etc.), the IDS preschooler was offered expo- 
sure to letters and words which would later be part of his 
actual reading instruction. Part of this early exposure was 
provided by materials that formed the first part of one of 
the generally available methods of teaching reading (e.g. , 

Stern, Sullivan) , which were incorporated into the Institute 
reading curriculum. 

The Stern method provides a series of workbooks and 
materials that are specifically designed for preschool use, 
and which emphasize the use of phonics in beginning reading. 

The Sullivan program also has a preschool segment: Readiness 

in Language Arts. This part of the Sul? Ivan approach can be 
used as a separate program in and of itself. It differs from 
the rest of the Sullivan materials in that it requires the 
direction of the teacher, while the activities stressed in 
the later materials are designed for children, to work with 
independently. The Readiness in Language Arts materials pro- 
vide for early exposure to such concepts as left-to-right 
progression in reading, letter names, letter sounds, and 
syllables . 

In addition to such published reading materials, children 
were offered an initial exposure to letters and words through 
specially developed IDS learning materials. For example, at 
prekindergarten children begin to familiarize themselves with 
the alphabet by working with the Letter Form Board , as pre- 
viously described. This puzzle-like learning device introduces 
the young child to the alphabet initially as a sensorimotor 
experience which involves him in the concrete manipulation of 
letter forms. 

As with other Institute developed materials , the Letter 
Form Board can be used in many different ways, on several 
intellectual levels, and for a variety of cognitive tasks. 

The Board can be used to teach the child to discriminate 
among letter shapes. It can also be used to familiarize 
children with the concept of left-to-right order in reading 
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and at a later level, to teach them the actual names of the 
Elions letters. The plastic letter pieces 

used in a number of different types of activities. They ^an, 
for example, be used for classification tasks, such as sorti g 
and matching capital and lower case forms of the same letter. 

SL they can be used by the child to build his own n^e or 
that ’of oL of his classmates, or to construct many other words. 

A variety of letter games that center around the child^s 
own name were devised by IDS for use with classroom materials 
other than the Letter Form Board (e.g. , individual flannel 
boards and letters) . These games provided interest and 

practice with, the formation of words from letters. They 

also formed part of the general, _ 

emphasize the child's own name and thereby helped to enhance 

his self-image. 

ThP T.anffuase Master is an example of equipment for which 
special materials have been developed by the Institute staff, 
me Language Master Is a species of tape recorder which records 
on and plays a length of tape which is on a l^nated card, 

which also has room for pictures P! 

of cards which we made for it, the teacher s voice ^ 

nn the tape first and than the child records his own voice ^ 
and listeL to his recording right after hearing the teacher s. 

In this way, he compares his speech pattern and senrence 
structure to the teacher's model. The machine and the card 
SSiSf permit a child to hear auditory and see visual st^i^i 
simultaneously. The opportunity thus to ate stimuli is 

particularly relevant to the first part of the . 

heading pro^am, which begins by stressing the relationship 

between sounds and symbols- 

The Language Master was designed primarily to be ^sad as 
an au^o!inSmc?LLl device. However, it was found that when 
you^f chUdren first began using it they needed - 
Lomit of direction and help. The amount of such direction 

and follow up done by the teacher has P^s^me^teLhers 

the individual child and the particular teacher. Some teachers 

listened to each recording with the child and 1 

discussed it with him; others have merely spot-checked a few 

^h^^fanS;rge*Sa^?e^ rL^r-fdfd ^he*^^aSher with valuable 
diagnostic information about each child. 

The initial exposure to reading offered to the °hild in 
preklndergavten and kindergarten was followed by exper^nces 
in the relding eurrieulun, of the IDS grades 
teaching of reading in the grades was begun by IDS in the 



of 1964-, when the first wave of children had reached the 
first grade level. The IDS reading program changed consider- 
ably over the years, as various methods and approaches were 
examined, modified, and discarded, or incorporated into the 
developing reading curriculum. 

The first reading program the Institute used in the 
grades was the standard public school basal reading program. 
Generally speaking, this emphasized the acquiring of a basic 
sight vocabulary as the first step in learning to read. The 
basal reading program was used in the Institute classes only 
for half of the first year, when it was replaced by the 
Jtern method. 

The Stern method is a total approach to reading that 
involves the use of a series of workbooks, graded from pre- 
school through the elementary grades. The primary emphasis 
in this method is on phonics , and it begins by having the 
child focus on the relationship between sounds and symbols. 

The child moves from associating sounds with symbols to 
blending sounds and combining symbols in order to produce 
words, sentences, paragraphs, etc. 

In the 1965-66 school year, a series of taped word 
recognition checklists was constructed (The Phonics Check- 
list) , These checklists were administered to determine if 
the children had acquired the word recognition skills that 
are included in the Stern workbooks; it provided diagnostic 
as well as evaluative information to the teacher. It was 
found that, although most of the children had mastered the 
beginning phonic skills, many were still having difficulty 
with blending the phonemic elements into words. It also 
appeared that, by and large, the children had not acquired 
the minimum sight vocabulary necessary to begin reading books. 

Consequently, several modifications of the original 
Stern program were made and introduced into the • enrichment 
classrooms. Af first grade, for example, instead of intro- 
ducing all twenty-six alphabet sounds and three blends, only 
ten initial sounds were taught; these ten sounds were, how- 
ever, immediately blended into simple words (such as the) for 
the children to use in reading. Teachers observed that this 
practice seemed to increase the child ^s facility in reading 
new words, even though only a limited knowledge of sounds 
had been acquired. Also, a few sight words were taught to 
be used immediately by the child in reading a whole sentence. 

In addition, trade books and supplementary materials (such 
as the I Can R e ad Series , the Merrill Linguistic Readers , and 
the Bank Street Readers) were provided in an atteinpt to enhance 
the children's interest in reading and to give them further 
practice in using their skills. 
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a. rGviGW of thG StGiri mGthodj Qnd its GffGctivGnGSS 
in thG IDS classroom, the toachGrs and curriculum specialists 
decided to further modify their program by the Sullivan 

Reading Materials . The Sullivan program basically consists of 
two parts, both, emphasizing phonics. The first part (for pre- 
school) is the Readiness in Language Arts program, which has 
already been described. The second part provides materials 
"that a child can work with xndependently , proceedxng at his own 
rate and not having to meet any established grade goals. 

The Sullivan materials are compatible with the Stern 
materials in that both programs emphasize phonics. However, 
unlike the Stern method, the Sullivan materials provide for^ 
the immediate application of phonemic elements to the formation 
of words. Moreover, the Sullivan materials provide the child 
with ample opportunities to review and check his progress as 
he proceeds through the reading program. These materials^ 
seemed to be suited to a program that placed great emphasis 
on self— pacing and independent learning. Although, in our 
opinion, there were inadequacies in both the Stern and Sullivan 
methods, the combination of these approaches and the additional 
use of supplementary materials constituted the core of the IDS 
reading program. 

Some of the supplements to the combined Stern-Sullivan 
reading program included class newspapers, classroom lending 
libraries, supplementary texts and trade books, and the like - 
all types of elements which are part of most good grade school 
programs. In addition, however , there was an extensive reper- 
toire of supplementary reading games which was developed by the 
Institute's teaching and curriculum development staff. 

As part of the IDS reading program, children worked with 
some of the equipment to which they were introduced in earlier 
grades. For example, the Listening Center was used by children 
in the grades program by having them work with specially con- 
structed tapes that help build comprehension skills; the Center 
could be used by teachers on all grade levels for diagnostic 
purposes in checking children's progress at all stages. As has 
been mentioned earlier, the Language Master could be used by 
the children in the grades to .practice simultaneous auditory 
and visual discrimination of sounds, words, and phrases. This 
device was used in all grades to practice many of the skills 
used in reading. 

Despite the changes in the reading program over the years, 
it can be characterized as a systematic attempt to build reading 
and language skills, starting from an initial appreciation of 
the sound-symbol relationship. Each part of the reading program 
was designed to follow a carefully constructed sequence of 
combining phonemic elements to build word recognition and com- 
prehension skills. It should be again emphasized that this was 



an individualized, phonics and language based program, which 
allowed each child to pace himself and to apply newly acquired 
skills to more sophisticated tasks. 




Mathematics and Science Curriculum - Prekindergarten through 
Third Grade 

The Institute's programs in the mathematics and science 
areas can perhaps best be described^ by first presenting a 
chronology of the development of these curricula, and then 
by giving examples of their components. Like those in language 
development and reading, the mathematics and science curricula 
have utilized both programs and materials that have been deve- 
loped and ' published commercially for use by children from the 
preschool years through elementary grades, and materials and 
teaching methods that have been devised by the Institute’s 
staff, specifically for use in its program. 

Development of the Institute’s mathematics curriculum 
began when the enrichment program still included only the two 
preschool years. Children in the preschool classes used pre- 
pared materials from such coordinated programs as the Rasmussen 
Math Lab Kits, the Stern Structural Kits, and the Cuisenaire 
Rods. These materials were later used, where appropriate, in 
other grades of the Institute’s longitudinal program. Also, a 
Math Manual was developed in order to assist the teachers in 
their presentation of mathematical skills and concepts. 

As the enrichment program expanded into the grades, the 
Houghton-Mifflin Math Manual was introduced, providing addi- 
tional structure to the program, and offering a supplementary 
teacher’s guide that was used in conjunction with our own 
IDS Math Manual. 

The other materials such as Cuisenaire Rods , Stern Struc- 
tural materials , Rasmussen Math Lab materials , were all designed 
to give the child an understanding of basic raa'thematical con- 
cepts, as well as to help him develop proficiency in certain 
skills (adding, subtracting, multiplying, using fractions, etc.). 

As this program evolved, the instruction of mathematics 
was coordinated with that of science. Mathematics could thus 
be used as a tool to carry out general operations of inquiry 
and to develop an understanding of scientific concepts; also, 
scientific methodology could be used to enhance the understand- 
ing and application of mathematics . 

The Institute’s combined mathematics -science curriculum 
emphasized a ’’process" approach. Basically, this means that the 
conceptual processes involved in learning specific facts, or in 
acquiring particular skills, were taught as an integral part 
of a total mathematics-science curriculum. For example, stress 
was placed on scientific method and inquiry (e.g., formulating 
and testing tentative hypotheses) , as well as on the particular 



facts that were arrived at from use of such a method. 

The format of all the materials that were used in connec- 
tion with ttie mathematics-science curriculum is consistent with 
this basic "’process” approach. The materials prepared by the 
American Association for the Advancement of Science (AAAS) 
provided the children with the opportunity to deal with a 
number of elemental processes necessary to the development of 
an understanding of scientific method and scientific phenomena. 

In the primary grades, children were introduced to such pro- 
cesses as observing, recording, measuring, predicting, using 
time-space relationships, etc. 

Particularly in the early grades, science and mathematics 
content was interwoven throughout the curriculum iii such acti- 
vities as discussions of weather and seasons, tirs:.„ growing 
classroom plants, oaring for classroom animals, tsik±ag trips 
to the zoo, aquarium, etc.,; cooking, where such cancepts as 
change of state with temperature are . involved; using magnets' 
and magnifying glasses; and in a myriad of ways t'^^t presenLisc. 
themselves throughout the day. 

The mathematics-science program began at a sin^^le, concrnte 
and manipulative level. The child followed a sten 'jjy step pro- 
gression from this manipulative level to one that involved hand- 
ling abstract and S 3 miboliG relation&.iips . As has been described 
above, the concrete materials used at this first level included 
size and colored cones, unifix cijbes, funnels, spoons, different- 
ly shaped and variously textured collage pieces, and the like. 

The handling of these materials vjas designed to help the 
child make discriminations, handle classification tasks, make 
generalizations, and to develop an appreciation of such concepts 
as textm?e (rough-smooth) , size (big-little) , quantity (greater 
than-less than), similarity (same as-different from), etc. 

Children at the beginning level also learned to count and identi- 
fy certain numerals (at prekindergarten, for exarr^le, at least 
from one to five) . 

On a somewhat more advanced and complex level, children were 
introduced to the concept of sets. Generally, this introduction 
took place in kindergarten, althou^ it is in no way fixed at 
that year. At first, the children dealt with sets, concretely 
5.dentifying and manipulating objects that could be associated in 
a set (all books, all crayons, all blocks, all pencils, etc.). 

The children then advanced to understanding concepts of different 
sets, unequal sets, and empty sets. After a child could appreciate 
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the basic notion of ’'set", he then used the sets for various _ 
mathematical operations (such as addition, subtraction, multi- 
plication, division). As mentioned before, children were 
taught early to recognize and write numerals . In the later 
segments of the Mathematics-Science curriculum, children used 
their knowledge of numerals to deal with symbolic relation- 
ships in the various arithmetic and algebraic operations that 
can be performed on sets. 

After developing a basic orientation to mathematics, and 
an understanding of some of the basic concepts involved, chil- 
dren then applied their knowledge to problems of measurement. 

In this regard, children dealt with linear measurements , sn 
perature measurements . They also started exploring geometric 
concepts, beginning with the recognition and description of 
shapes, angles, and the like. Again, the progression was from 
cc icrGtG to thG abstract • A chiXd might havG bGgun Gariy 
in' the program by manipulating objects which differed in size; 
later he might have been asked to compare the heights of people, 
and than to go on to using units of linear measurement as 
represented on a ruler or yardstick. 

-the grades, this basic understanding was then aj. plied 
to other types of measiirements , as well as to various mathe- 
matical operations. Children worked with measuring forces 
with springs, ordering plane geometric figures by areas, plotting 
coordinates, interpreting graph data, etc. Moreover, these 
latter two applications of the basic concepts of measurement were 
then used in various activities involving scientific experimen- 
tation (e.g., plotting the temperature rise in an experiment and 
interpreting the graph produced) , thus appropriately combining 
and mathematics curnculum elements. 

All the prepared materials that were described above were 
used along with mathematics games and guidelines that were 
developed for all grade levels of the IDS program. 'Hiese Insti- 
tute-developed materials were used as supplementary in those 
areas covered by the prepared materials, and were- used as well 
as reso-urce materials for areas not covered. 

Creative Dramatics — Prekindergarten through Third Grade 

Creative drajnatics, or guided dramatic play, was in-troduced 
as part of the Insti-tute’s overall curriculum early in 1966, 
under the supervision of a specialist in this field. Particular 
emphasis was placed on the use of creative dramatics as a method 
to vitalize curriculum skills of the children, to teach inference- 
making and problem solving, and to develop imaginative thinking. 
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Daily logs’ ‘of~ aathematics-science activities, .kept by IDS 
teachers, may be foimd in Appendix III, to this report. 



Because creative dramatics was improvised (i.e., the parti- 
cipant made up the dialogue and action as he played, and imme- 
diately tested his inferences within tlie content ot Idle playing 
and plot) the children were hi^ly motivated ro question, to 
test alternative hypotheses, and to examine fee dimensions of 
humian behavior and experience. Since the medium was oral commu- 
nication within the conxext of action, children who participated 
were directly engaged in utilizing a wide range of cognitive and 
communication skills — vocabulary, language, patterning, inflec- 
tion, sequence, clarity, ttc. 

In developing the creative dramatics program the specialist 
worked with Institute supervisors to review currictilum areas and 
partioxilar grade level problems, and observed, classes in progress 
to note areas in which cr eative dramatics might be profitably 
used as a teaching approach. She then worked with children for 
several weeks, as well as with the teachers snd assistant teachers 
who observed and partici.iated in the dramatic: play. Consultations 
between specialist and individual teachers were held to discuss 
the approach, the child. "en’s responses, and to plan the teacher *s 
first use of this method, and its further elaboration in their 
classrooms . 

One of the major en^hasis of this program was to add the 
tool of guided dramatic play to the teacher’ s repertoire of skills 
at all grade levels, and also to help the teacher use it as a 
method of teaching content in the various curriculum areas. 

A pantomime unit and a number of dramatic improvisation games 
were pilot tested, revised, and made part of the curriculum in 
the grades. The pantomime unit was introduced to the children 
first, as itwa^ action-oriented rather than verbal. The skills 
learned in the pantomime unit were to be used later in the dramatic 
inprovisation games. 

Teachers have observed that the program in creative dramatics 
helped to in^rove the children’s attention span, quest ion- asking 
behavior, and the quality of their expressive language. Unfortu- 
nately, when funding for curriculum development was reduced, progress 
in the creative dramatics area was severly curtailed. 

In-Service Training 

The efficacy of all facets of the IDS classroom program was 
related to the success of the continuous in-service training of 
all professional staff. Teachers, assistant teachers, supervisors, 
curriculum specialists, and the curriculum director met to engage 
in special training workshops , as well as to discuss common pro- 
blems and develop new curriculum materials and relevant educational 



strategies. 

Tliis in-service rraining provided an essential feedback 
fimation, calling for the constant review of the effective- 
nrass of classroom materials and teaching methods. It arso 
established a forum for ongoing analysis of the charaGt£~‘is— 
tics and effectiveness of individual teachers, teams of teachers, 
and their classrooms. Such constant review and analysis was 
critical to the dynamism of a program, and to insuring its 
continuing relevance and effectiveness. 

The primary goals of the in-service training program 
included : 

1. sensitizing teachers to the abilities and needs 
of children from socioeconomically disadvrantaged 
backgrounds; 

2. helping teachers re-examine their own values, 
stereotypes, and possible prejudices; 

3. training teachers in the rationale, content, 

and methods of the Institute’s enrichment program; 

M-. involving teachers in the process of curriculum 
innovation and of implementing these changes; and 

5. providing clear delineation of the role of the 
assistant teacher in the classroom. 

An essential element in achieving these objectives was 
simply providing time for training to take place. Since pre- 
kindergarten and kindergarten teachers had morning classes, only 
their afternoons offered extended periods of time for workshops, 
training sessions, and conferences with supervisors. First, 
second, and third-grade teachers had classes until 3:00 P.M. , a 
fact which made it more diffictilt for them to participate in 
activities related to in-service training. 

The process of sensitizing teachers was accomplished in a 
number of ways. Institute research staff reported and discussed 
with teachers their own findings, as well as findings of others 
working in this field. The social service staff contributed its 
knowledge about the home environments of the children and helped 
teachers to understand how this environment could affect children’s 
motivations and school performance. Also, teachers were familia- 
rized with the variety of social services that were available to 
the children and their families, so that they could make appro- 
priate referrals as the need arose. 

A major aspect of in-service training was educating teachers 
about the rationale, goals, content, and methods of the Institute s 
enrichment program. For new prekinclergarten teachers, there was 
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an intenisive three-week orientation period before classes began- 
Throughout the year, g:e-ier"iLly c’n a twioe-a-week basis, all 
teacher s attended v:crl: Si ^oc: a and seminars conducted by various 
InstitLta staff memoer n outside speakers, and consultants to 
the Ine—ltute, 

VJhaa the seminar topics involved ctirriculum content, methods 
and materials, the leaders of the workshops relied heavily on live 
demonstrations with children. In most cases, the Institute's 
supervisors and consultants acted as workshop leaders in order to 
apply their overview of the program to the integration and arti- 
culation of the curriculum cong)onents being demonstrated. Curri- 
culum specialists, supervisors, and teachers worked together to 
follow the curriculuin innovations into the classroom, and to make 
appropriate revisions and modifications before they were made part 
of the Institute's enrichment program. 

Perhaps one of the strongest elements of the Institute's 
in-service training program was the direct supervision of the 
classroom teachers by the supervisor. The hi^ degree of both 
quality and quantity of supervisionwas made possible throu^ low 
teacher-supervisor ratios. (Generally, each supervisor was 
responsible for the staff of no more than six classrooms.) 

Because there was one supervisor in each of the schools housing 
the IDS classrooms, the si:q)ervisorswere able to observe the teachers 
in action regularly and frequently, and to follow each of the obser- 
vations with a conference to single out and reinforce particularly 
effective activities, as well as to work out whatever problems they 
may have detected. 

As the teachers became familiar with the goals and practices 
of the Institute’s enrichment program, they were encouraged to 
participate in the actual ing)lementation and evaluation of curri- 
culum and to become innovators of curriculum themselves. To the 
researcher and curriculum specialist, the teacher, with her know- 
ledge of, and experience with, children, was an inivluable ally 
in the development, implementation, and evaluation of new curricu- 
lum components. IDS teachers, for exanple, played an uiportant 
role in devising games to reinforce reading and mathematics skills, 
preparing tapes and cards for use in the Listening Center and with 
the Language Master, reporting on the effectiveness of new programs, 
and supplying ideas for appropriate revisions and modifications of 
curriculum. The involvement of teachers in the process of trans- 
lating research into practice was a potent training strategy, as 
well as an effective means of accomplishing the translation. 
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In rnan 3 <' abjnent programs, tihe part assistant teachers 

play in classrr:-':" procedures is nebulous and haphazard. The 
effort to del:i:i: - the role of the assistant teacher and to 
develop produ~r: "working relationships in the classroom was 

one focus of service training program. In order to 

accorr^jlish tblK; observations were made by selected Institute 
staff at the bs^-unrilng of the year, and these observations 
were used by s-ptir^visors to devise ways in which assistants 
could work mors 6=ff actively. 

In many i_~-r-moes, previously unlicensed assistant 
teachers have on to receive licenses and to become head 

teachers in thi;. b:_3titute^s demonstration classes or in other 
programs . 



Parent I’rogram 



One of the essential features of the total IDS program 
was the plan for parent involvement. This plan grew out of 
our original commitment to the IDS parents --one that want 
beyond offering experiences to their children in the enrich- 
ment classrooms. The parent program was established with a 
view to increasing the continuity between home life and 
school life for the child. Minimal continuity between home 
and school is a fairly typical feature for children in low 

income areas. 

To this end, the Institute explored several avenues for 
involving parents in their child ^s formal educational ex- 
periences, and for involving the Institute’s staff in the 
broader context of the child’s life outside of school. A 
team of social workers, community aides, and educational 
specialists worked together to establish a Parent Center, 
and to create a program providing for meaningful parent 
involvement and open communication between parent and teacher. 

The activities of the parent program fell into three 
major categories: 

(1.) activities that centered around the classroom and educa- 
tional materials ; 

(2.) those that involved the relationship between parent and 
teacher; and 

(3.) those that revolved around the life problems common to 
many of the families involved in the program. 

Each of these activities will be discussed briefly below. 

A major effort was made to familiarize parents with the 
activities of the classroom and with the classroom materials. 
Parents were encouraged to visit the classroom and observe 
their child as he worked and interacted with his teachers and 
classmates in this setting. Training sessions were held to 
further acquaint parents with the classroom materials and to 
discuss and demonstrate curriculum elements that could 
properly be used at home to enhance the child’s learning. 

For instance, parents constructed some of the games (such as 
number sorting games and boxes with items whose names sound 
alike) that their children were working with in school and/ 
or that could be used at home. This provided familiarity for 
the parent with the game, and also provided materials for the 
child to use at home. 

In these parent training sessions, some of the different 
uses of classroom materials were demonstrated, and some of the 
reasons underlying the choice of different pedagogical tech- 
niques and choice of materials were explained and discussed. 



For example, in one session parents were shown how finger 
painting could be important to the child’s muscular develop- 
ment (particularly those muscles of the hands, arms, and 
fingers that would later be used in writing} , as well as 
to his free expression. At one session, parents were given 
a demonstration of a teacher reading a story to a child, 
and this was followed by discussions and role-playing 
activities to help them explore the various learning experi- 
ences that could be related to reading a story to a child. 

In addition to classroom observations and the training 
sessions described above, the attempt to establish good 
parent-teacher relationships included home visits by the 
teachers and assistant teachers. These visits helped to 
establish a positive relationship and open communication 
between parent and teacher, while helping the teachers learn 
more about the child in the context of his home setting. 

Moreover, for the prekindergartners , teachers’ visits also 
eased the initial adjustment to school. The home visits 
made by the prekindergarten teachers helped them to decide 
the time that a particular child was to be phased into the 
program (as discussed earlier in the discussion of the pre- 
kindergarten and kindergarten program) . 

A central meeting place for parents and Institute staff 
was provided when the Parent Center was established in 1966. 

The Center was housed in the neighborhood settlement house 
of a local church. This center was used by parents for a 
number of different activities including: club meetings 

(e.g., for the sewing club or the knitting club); sessions^ 
to work with classroom materials; discussions with the Social 
Work Director and her staff (social workers, community aides, 
and educational specialists) about common problems such as 
housing, nutrition, safety, etc.; and planning for common 
activities (such as the Third Grade commencement party, book 
fairs, workshops on black heritage, welfare rights, consumer 
buying, legal aid for the poor, etc.). 

In addition to such activities, the Institute has been 
able to provide various social services for the families o 
children in the program. The social work staff, for example, 
has helped to expedite problems that related to housing and 
welfare; when indicated, community aides have escorted parents 
to the appropriate community agency and helped them handle 
tlie pt‘oc0dures there. Cornmunity aides also escorted the pre- 
school children to school if they were not able to attend 
otherwise. 

In addition to these active and specific problem oriented 
services, a clothes bank was established at the Parent Center, 
from which parents could draw if they needed and wanted to. 

The clothes bank had direct impact on the classroom program, 
in that it helped to cut down a substantial portion of absenteeism 



attributable to the lack of adequate clothing available for 
the children to wear to school. 



Although the above discussion has described the parent 
program as it operated through the time period covered in 
this report- two additional features of the current program 
will be mentioned. In 1968, a Home Instructional Program was 
piloted. This program provided training for parents whose 
third grade children were falling behind in reading. After 
training sessions with members of the Institute staff, parents 
worked with children at home to help them overcome their 
reading difficulties. This plan was subsequently modified 
when it appeared that tutoring could not always be carried 
out by the parent in the home. In some instances, other tutors 
were provided to work with the child outside his home. Parent 
Involvement in this program therefore ranged from tutoring the 
child in the home or elsewhere, to observing the other tutor 
work with the child, to simply being informed about the natux’e 
of the tutoring activities. In addition, efforts were made to 
encourage the cooperating schools (^those in which the Institute's 
classes operated) to implement certain aspects of the Institute s 
Parent Program. These efforts were designed to broaden the 
base of impact of the IDS program and to establish programs 
that would then involve the total community - 



Extramural Training 

Although the Extramural Training component of the IDS 
program has only tangentially influenced the results described 
in this monograph, a brief description of this component will 
be given. More detailed information is available in The Final 
Report to the Office of Economic Opportunity (OEO Contract 
#24-25) . 

Requests for training in all aspects of early childhood 
education came to the Institute from all parts of the United 
States. The Institute's demonstration classes, equipped witri 
one-way vision walls were observed by thousands of early 
childhood educators. The Institute's training staff has 
guided these observations, helping to orient and traxn those 
who came to the Institute. Moreover, information about the 
IDS program and reports of Institute research have been sent 
in response to continual requests from interested educators, 
psychologists, and other behavioral scientists. 

Members of the Institute's training staff conducted 
workshops and led discussions for the interested visitors 
v^ 7 ho came to observe the program. In addition, they worked 
wi-^h personnel in many communities throughout the United 
States, providing guidance for those who wished to follow 
the Institute's model in establishing their own programs. 
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For the past five years (1965-1970) , the Institute training 
staff has worked with rural and urban Head Start groups, con- 
centrating on local program and staff development. The training 
staff has worked also with a wide spectrum of educators (includ- 
ing administrators, supervisors, teachers, and paraprofessionals) , 
lecturing and giving workshops in the many communities they 
worked with, as well as guiding those who came to the Institute 
itself. 
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METHODS, rCONTINUED*) 



Evaluation Procedure 



Subjects 

The children involved in this program (the experimental and 
control subjects) were black, of both sexes, aged four to nine. 

They were drawn from sections of an inner city, "ghetto" area of 
a large northeastern city.^ 

Sample Selection 

As the program became established, an increasing number of 
parents volunteered their children for it. However, particularly 
in the early stages of the program's operation, it was also neces~ 
sary to conduct active recruiting in the community. Staff members 
obtained the names of children from a variety of sources; from 
church groups, from response to posters, from word-of-mouth infor- 
mation, from other children, from teachers and principals, etc. 
Minimal demands were then made on the parent (s) , who were asked 
to respond to a short interview given in their home and to bring 
their child to the school for a short observational period. 

A final sample was chosen from the group that had been gath- 
ered through these recruitment procedures. The children selected 
met the following criteria: 

1. The child met New York City age requirements for admission 
to public school kindergarten in September of the following 
year. 

2. The parent was prepared to assume responsibility for bring- 
ing the child to school. ^ 

3. The child and parents were English speaking. 

4. The child was in generally good physical condition. He 
or she had no serious orthopedic difficulties, or obvious ab- 
normalities in hearing or vision. 

5. The child had no serious emotional disturbances or be- 
havior problems that could be detected at the time of obser- 
vation. 

6. The child was in the low socioeconomic (SES) classifica- 
tion, as defined by the Institute’s SES Scale. (This scale 
uses the amount of education and the occupational status of 
the family's chief breadwinner as its criteria for SES classi- 
fication. A copy of the scale is in the appendix.) 



1. Other populations were used at various times, but longitudinal 
data are not available for the other groups, and hence they were not 
included in this report. 

2. With the advent of funding programs for community and school 
aides, this requirement was eliminated. 





ClaGsification of children with regard to SES was particularly 
importani: in the early years of the program's operation. In the 
later years, it seemed unnecessary to continue this rigid classifi- 
cation procedure, as it is known that the school districts involved 
are composed almost entirely of lower SES persons. In addition, 
thv'a Institute assumed the responsibility ior enrolling younger sib- 
lings of those children already in the program; thus, some of the 
famililies who volunteered for the program in tae Later years had.* 
already been checked for SES classification. 

Formation of Control Groups 

Approximately one third of the children selected by the above 
criteria could not be handled by the small number of Institute 
classrooms, and these children, chosen randomly from the total N, 
constituted a control group. Since this group was equivalent to 
the experimental g??oup in parental motivation and desire for the 
child to be part of an enrichment program, it was designated the 
control group for the factor of self selection, and is referred to 
subsequently in this report as the Css group. The experimental 
group was given enriched schooling from prekindergarten through 
the third grade, while the Css group first encountered foumal 
schooling in the regular kindergartens (or, in some cases, first 
grades) of the New York City public school system. (Although most 
Css children began school at kindergarten, this was not stipulate 
as a requirement when the group was originaTiy formed.) 

In order to provide further controls for the IDS program, two 
additional control group?, were constituted, one at the beginning 
of each of the next two successive years. The first was the kin- 
dergarten control” or Ck group. This was composed of cnildren who 
had no prekindergarten training and who entered the kindergartens 
of the same public schools that the E and Css groups attended. 

When the Ck group vjas selected, of course, the E and Css groups 
were also entering kindergarten. Apart from the time of their 
selection, the children in this group differed from those in the 
Css group primarily in that they were not recruited nor had they 
volunteered for the Institute's program. The second additional 
control group was constituted at the beginning of the following 
school year, and included children who entered the same pv^alic 
schools as the other groups at the first grade Level. They had no 
prekindergarten and no kindergarten experience (see footnote 3, 
below) . 



3, In the Later years of the program. Head Start was in full 
swing, and, to obtain a sufficient number of children for the Ck 
group, it was necessary to include children who had been in the 
Head Start program. Their inclusion, of course, would have the 
effect of minimizing E vs. Ck differences, and thus was an experx- 
mentally conservative choice. 
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Waves 



wave of children was admitted to IDS prekindergarten 
classes in January of 1963.^ Starting in .'eptember of 1963, and in 
each successive fall, a new group or ”wave’ Oj. children egan t e 
IDS program at the prekindergarten level. Thus, at the present 
time (197 G) , the first waves of children lave compLeCed five years 
of enrichment (through grade three) and the ourtb v;ave of chil- 
dren has comple ced four years of enrichment (through grade two) . 
Except where otherwise noted, the first four waves of children are 
included in the evaluation presented in this report. 

The numbers of children available for evaluation in any one 
year varied for a number of reasons. While each Institute prekin- 
dergarten classroom began with seventeen children because of vary- 
ing of funding the number of prekindergartens operating changed 
from year to year. 

In addition, within any one wave, more than one-half of the 
children dropped out between the beginning of prekindergarten and 
the end of third grade. (Geographic mobility of inner city, ghetto 
populations is typically found to be this high or higher— see Gold- 
berg, 1967.) The drop-outs from the experimental group were re- 
placed by other children who were chosen from the regular school 
classes by non- Institute school personnel, to fulfill the class 
*=ize requirement of the Board of Education (in Kindergarten, _ 

example, class size had to be 25, in first grade, 30). The- chil- 
dren are called "fillers," and some were added each yca^- ^^ta 
were gathered on these children, but the scores have not been in- 
cluded in the analyses presented in this report, as the fillers ^ 
were not strictly comparable to experimental or control children. 

The number of children in the control groups was limited not 
only by attrition due to geographic mobility, but also by the dif- 
ficulty involved in obtaining the parental permission needed to 
test each child; and the occasional selection from the control 
sample of a "filler’! child who then entered an experimental class. 

School Settiiig 

The Institute’s classes were housed in several of the regular 
public schools in Manhattan, including the Lower East Side, the 
Upper West Side, Central Harlem, and East Harlem. The children 
whose test scores are reported in this report have attended the 
Institute’s classes in Central and East Harlem. 



M-, Children in the first wave were enrolled and pretested in the 
fall of 1962. As time was necessary for planning and further or- 
ganization of the program, actual prekindergarten classes did not 

begin until January of 1963. ^ . 

5 ^ piller children tended to score higher on ability measures 

than either the norm for the school or for the E group. 
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Each of the host schools had several Institute and several non- 
institute classrooms on each grade level. The prekindergarten 
level was an exception to this in that, for the time period 
covered in this report, the New York City Board of Education did 
not sponsor regular prekindergartens in these schools. 

The relationship between the Institute and the schools has 
been affected by the high turnover rate of the schools ' regular 
supervisroy and teaching personnel. Furthermore, over the years, 
the relationships among the Institute, the various schools, and 
people of the communities, changed a great deal. Many people in 
the Harlem community first reacted to the IDS program with suspi- 
cion and a certain amount of hostility. This may have been at- 
tributable to their view of the Institute’s program as ’’just one 
more short-lived program that experimented with black children.” 
Initially, teachers in the schools also regarded this program with 
hostility and suspicion. For them, this may have been a result of 
the fact that, at first, the Institute tried to operate in isola- 
tion from the rest of the school, discouraging communication which 
would result in the diffusion of experimental curricula to non- 
experimentai classrooms (and the contamination of control groups) . 
Both community and teacher’s reactions were subsequently modified, 
as the Institute’s program became more established and as the in- 
teractions between Institute and non- Institute staff increased. 

As will be discussed below, a conscious effort was made later to 
extend the impact of the Institute’s program to involve those in 
non- Institute classes.® 

The United Federation of Teachers’ strikes of 1967 and 1968 
also had an impact on the Institute’s program and on the communi- 
ties in which it operated. . The strikes resulted in, among other 
things, a great deal of administrative confusion within the indiv- 
idual schools. Tension developed between the communities and the 
schools, as well as among the staff members of individual schools. 
Institute teachers, and many of their colleagues in inner city 
schools, did not support the strikes. Despite this fact, the 
tensions and confusion associated with them (both in the schools 
and the communities) affected the children in, and the operation 
of, the IDS program. 

Community Setting 

Harlem is too diverse a community to describe simply or to 
characterize as one unit. In general, the Institute’s staff has 
found that the families involved in this program live in condi- 
tions of economic deprivation; in crowded and unsafe housing; 
in an area characterized by high drug addiction rates, high crime 
rates, low employment rates, and inadequate health facilities. 



6. These efforts were undertaken despite the fact that they 
would result in diffusion. The Institute’s concern, of necessity, 
was primarily with service to ihe schools and communities in which 
it operated, and only secondarily with the strictness of experi- 
mental design. 

O 

ERIC 



38 



( 35 ] 



The community in which the Institute operated was marked by 
a heightened awareness of political, social, and educational issues 
that were related to the educational welfare of children. Further- 
more, in the time period covered by this report, the Harlem commu- 
nity was a focal point for the "Black Liberation Movement." Par- 
ticularly in the late 1960s, the people in the Harlem community 
began to demand increased control over their own institutions and 
destinies. To cite just one relevant example, one of the schools 
in which the Institute’s classes were housed was part of a demon- 
stration district that was set up as an experiment in community 
control.^ 

Description of Assessment Instruments-General Plan 

Both experimental and control children were given a number of 
tests of ability and achievement, the limitations of which will be 
discussed below. These tests were given by Institute personnel who 
were trained and experienced in test administration. Children 
within experimental and control groups, and from the various schools 
were randomly assigned to testers, 30 each tester administered mea- 
sures to subjects from all groups. It was not possible to vai y 
systematically the race and sex of testers, because at the time the 
evaluation began, qualified black testers were too few in number xn 
the New York area. As indicated in the test description below, 
jTiQst measures were individually administered, though several were 
given in small groups. The sole exception to this procedure was in 
the administration of the Metropolitan Achievement Tests: these were 

given to groups of children by the classroom teacher or the grade 
supervisor . 

In general, there were six testing periods (pre-prekinder- 
gax-'ten, post-prekindergarten, post kindergarten, . post first grade, 
post second grade, and post third grade), with the pre-prekinder- 
garten testing being done in the fall, and the other periods oc- 
curring in tVie spring of each year. It should be noted, however, 
that the Ck and the groups received initial tests at the begin-g 
ning of kindergarten and of first grade respectively, in the fall. 

In order to control for possible test experience effects on 
post test results, only half the E and Css children of the first 
wave frandomly chosen) were pretested on the Stanford— Bine l Intel- 
ligence Scale (Form L-M) and the Peabody Picture Vocabularly Test. 
Since no such effects were found on either test, pretests were 



7. The degree of control actually accorded to the communities in 
these experiments is however, equivocal; the degree to which they 
have affected the quality of education has not been clearly estab- 
lished. For further discussion, see Wilson, 1969. 

8. Obviously, these control groups by definition could not be 
selected until the fall. However, their test results are compared 
with the spring testing for the previous grades. 



administered to all children of subsequent waves. ^ 



A summary of tests and testing periods for four waves of chil- 
dren appears in Table 1. 

Intelligevice Tests 

Stanford- Binet (S-B) : The Stanf ord-Binet Intelligence Scale 

(Form L-M - 1960) was administered to experimental and control chil- 
dren at the following testing periods : prc-prekindergarten , post"* 
prekindergarten, post kindergarten, and post third grade. The manual 
of the 1960 revision of the Stanf ord-Binet reports that the test 
measures "general intellectual ability." Evidence of che validity 
of the 1960 version rests only on the selection of items from the 
1937 version. Items retained showed an increase in percentage of 
persons passing the item with an increase in age; they correlated 
well with the test as a whole. The manual does not report re- stan- 
dardization with the 1960 version, nor does it give test-retest 
reliability. However, the IDS sample has been used to obtain stability 
coefficients, these being .7? for the E group (N=161) and .62 for the 
Css group (N=4-4^) between the pre-prekindergarten and post- prekinder- 
garten testing periods; and .72 for the E group (N=161) and .74 for 
the Css group (N=44) between the post-prekindergarten and post kin- 
dergarten testing periods. 

Lorge-Thorndikc (L-T) : The Lorge-Thorndike Intelligence Tests 

(Level 1 - non-verbal battery) were administered to first and second 
grade children in the spring of each year. It was used instead of 
the Stanford-Binet at first and second grade in order to avoid a _ 
practice effect on the Binet. The Lorge-Thorndike is easily admin- 
istered as it is a group test. For this research it was given to small 
groups of 15 children at a time, by two examiners. It is designed 
to measure "abstract" intelligence and, at the two lowest levels 
(from approximately kindergarten to third grade) , only non-verbal 
items (pictures of familiar objects or simple geometrical figures) _ 
are used. Standardization has been carried out in 44 states of this 
country . It is OT 10 of tli 0 f 0 W t 0 sts tVi3t hss h st 3 nd& 2 ?di 23 tion 
population consisting of persons on varying socioeconomic levels. 
Fveliability coefficients greater than .76 (as high as. SID) have been 
obtained by estimating the correlation betw’een Forms A and B of the 
test. Validation studies have employed correlations with achieve- 
ment and intelligence tests, as well as with measures' of later 
academic success (Freeman, 1959’'. 

Language Development Measures 

The Peabody Picture Vooabularly Test (PPVT) : The PPVT is an 

Individually administered test and was used at the same testing 
points as the Stanford-Binet. The test can be considered one of 



9. See Deutsch and Goldstein (1967a) and Deutsch and Goldstein 

(is 6 7b) . 




F.VAT,T]ATION SCHEDULE - FIRST FOUR WAVES 
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!i? 0 C 0 ptive vocabulary. Tha child is askad "to point to ona of four 
picturas that represents the objects or activities named. The marrual 
raports that altarnate form raliability rangas from .67 to .8<+ da- 
panding on age level (Dunn, 1959). Stability correlations have 
been obtained for the IDS sample between post-prekindergarten and 
post kindergarten. These correlations were .63 and .67 for the E 
(M=160) and Css (N=52) groups respectively. Standardization of 

rest was based only on a sample of children with varying 
IQs in and around Nashville, Tennessee; evidence of validity rests 
on correlations wi~h various intelligence measures, e.g. , high 
.70s and low .80s with the Weschler Intelligence Scale for Chil- 
dren test (Piers, 1965). 

The Illinois Test of Psycholinguistic Abilities (ITPA) The 
ITPA assesses language development, and provides a diagnostic pro- 
file for each individual. The design of the subtests, each mea- 
suring a specific psycholinguistic ability, is based on a revision 
of Osgood’s model of human language usage. Three major dimensions 
are postulated to specify a given psycholinguistic ability: level 

of organization, psycholinguistic process, and channel of communi- 
cation. Briefly, these may be described as follows: 

Level of organization : This re-’ers to the functional com- 

plexity of the organism. (1) The representational level of organi- 
zation is required to mediate activities which involve meaning or 
significance of linguistic symbols. (2) ihe a utomatic- sequent iax 
level of organization is required to mediate activities which in- 
volve retention of linguistic symbol sequences and the execution 
of automatic habit-chains. 

Psycholinguistic process : This refers to the sets of 

habits required for normal language usage. (1) Decoding habits ^ 
are required to obtain meaning from visual or auditory linguistic 
stimuli, ( 2 ~) encoding habits are required for expression in words or 
gestures, and (3) association habits are required to manipulate lin- 
guistic symbols internally . 

Channel of communication : This refers to the sensory- 

motor paths over which the linguistic symbols are received and 
responded to. Channels of communication are divided into mode 
of reception (auditory or visual) and mode of response (motor 
or vocal) . 

The 1961 version of the ITPA was individually administered 
to Wave I children at the first, second and third grade levels. 

All 9 subtests were used frepresentational level : auditory deco- 

ding; visual decoding; auditory- vocal association; visual-motor 
association; vocal encoding; motor encoding; automat ic- sequential 
level: auditory-vocal automatic; audi L'ory-vocal sequential; 

visual-motor sequential). 
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Test-retest reliabilities from .18 to .86 (median value 49. 5) 
for the various subtests and .70 for the total test ware obtained 
for one age group (6.0 to 6.6) (McCarthy & Kirk, 1963). 

The 1968 version of ITPA was given to children in Waves 
4- and 5 at second and third grade. Six of the 10 subtests were 
chosen in order co cover audicory and visual aspects at the repre- 
sentational and automatic levels. Criteria used in selection o 
the subtests were: applicability of the subtests; administration 

time; and kind of information tapped by the subtest. The 6 suh- 
tests used were: auditory reception; visual reception; auditory 

association; visual association; sound blending; and visual closure. 
Little reliability and validity information is available on this 
version of the ITPA. 

Reading Achievement 

The Metropolitan Achievement Tests: The Metropolitan Achieve- 

ment Tests are given to all elementary school children in grades d 
and above in the New York City school system. The test is given 
in the classroom, by the classroom teacher or grade supervisor, 
it is usually administered in the spring of each year. The Re|^ns 
Subtest consists of 2 parts: Word Knowledge and Reading ^^ Word 

Knowledge is essentially a vocabulary measure, and Reading is es- 
sentially a comprehensive measure. The Arithjqgli*^ Subtest also 
consists of 2 parts, these being Computation and Problem ^SolVjj^. 

At the discretion of the school, different children in the same 
grade may be given more or less difficult forms of the sabtests. 
Thus, raw scores must be converted into ”grade equivalent" scores, 
since only grade equivalent scores can place the variant forms in _ 
the same frame of reference. (A score of 3.4 means that a child is 
reading at the level of third grade, fourth month.) Robinson (1965) 
reports that reliability for each subtest is good (.79 to .96) and 
that a measure of validity has been obtained through careful study 
of curricula, judgement of experts, and repeated experimentation. 
Standardization has been carried' out throughout 49 states in the 
United States. 

Reading Prognosis Test: The Institute’s Reading Prognosis 

Test was designed to tap skills that are involved in the reading 
process and was devised to predict success in reading. It con- 
sists of seven subtests, grouped in three areas as follows: 

(1) Beginning Reading (Alphabet Letters, Sight Vocabulary): 

(2') Perceptual Dis criminal ion (Auditory Discrimination, Visual 
Similarities, Visual Discrimination); and (3) Language (Meaning, 
Vocabularly, Story Telling) . 

Validation studies of the Reading Prognosis Test have t>een 
done with both lower and middle class samples in the New York City 
vicinity. These studies have employed correlations with standar- 
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dized reading test scores at the end of first grade. Predictive 
correlations obtained for the lowest SES group range from .CO to 
.82 (Weiner & Feldmann, 19G3) 

The Early Childhood Inventories; The Institute’s Early Child- 
hood Inventories^^ were devised to measure particular curriculum 
elements, and to tap specific skills. Inventories tapping the 
following skills areas were used: Alphabet Names (ANI) ; Numeral 

Names (NNI-1) ; Body Parts Names (EPNIT ; Shape Names (SNII ; 
tional Concepts (RCI/PM) and (RCI/PS)1^; Quantity Matching (QMI) ; 

Set Matching (SMI) and Prepositions (PI). 

The Early Childhood Inventories (ECI) were given at the end 
of kindergarten to all E and Ck children of Waves 5 and 6. Although 
the inventories were also administered at prekindergarten and at 
first grade, only measures taken at the end of kindergarten are 
included here, (Ck children were not available for prekindergarten 
testing and first grade scores for most of the inventories were 
relatively close to ceiling.) 

Evidence of pretest equality can be cautiously inferred from 
that cited in previous waves’ performance on the S-B and PPVT, 
where no significant pretest differences were found. Because of 
these limitations in using standardized instruments, which will be 
discussed later, a section on Qualitative Evaluation has been in- 
cluded in the Results section of this monograph. ^ These evaluations 
were drawn f^'orn observations by and interviews with teachers, super- 
visors, school administrators, parents and observers. Unfortu- 
nately the Institute was not funded for the kinds of extensive 
interviewing and observation that would have been necessary tor a 
more inclusive evaluation. However, although limited, the state- 
ments obtained do form a very important part of the total assess- 
ment procedure and should be considered carefully in interpreting 
the data presented in this report. 



3.0. The Early Childhood Inventories were developed by Jack Victor 
and Alan Coller, some of which have been used by the Stanford Re- 
search Institute's national evaluation of Head Start and Follow 

Through. , •, 1 - • 

11 Relational Concepts inventories i .^lude one dealing wii-h 
pre-mathematics skills and one dealing with pre- science skil.ls. 
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FINDINGS AND ANALYSIS 



QUANTITATIVE EVALUATION 

General Analysis Procedures 

In most cases, results were analyzed by two-way analyses 
of variance (Wave X Subject Group) , despite the longitudinal 
nature of our evaluation. A repeated measures design witli 
testing period as the repeated measure, was not employed. This 
decision was made because of the large attrition that took 
place in our sample. (As noted previously in the Procedure 
Section, attrition in this popiolation is generally hi^.) 

In order to take advantage of the larger n^s available at 
early test periods, separate analyses for each test period were 
performed. Approximately one third of the pretest sample for 
both E and Css groups remained at the end of the third grade. 

Analyses of Variance tables will be summarized in the body 
of this report. Complete analysis of Variance tables will be 
reported in Appendix I, 

Differences between subject groups were further investi- 
gated by means of orthogonal comparisons. At the post prekin- 
dergarten level (the pretest for the Ck group) , comparisons of 
the E to the combined control groups (Css-Ck) , and the control 
groups to one another (Css vs. Ck) were carried out. This 
latter comparison was dropped when the post prekindergarten 
similarity of the two groups had been established, and, at all 
further levels, the following three comparisons were used: 

(1) E vs. Css-Ck (i.e., E vs. control groups starting school 
at kindergarten) ; (2) Civs. Css-Ck (i.e., controls starting 
school at kindergarten; (3) E vs. Ci (i.e., E vs, controls 
starting school at first grade) . 

Attrition Analysis 

In order to determine if the character of the sample 
changed as a result of attrition, (i.,e., whether the attrition 
was selective) , an analysis was performed to compare the pretest 
scores (on S-B and PPVT IQ tests) of those children who had 
dropped out of the program at different points. The analyses 
were two-way, with the independent variables being Subject 
Group and Drop Out time (prior to end of pre-K, K, 1,2,3; no 
drop out) , 
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Table 2 contains means, n»s, and standard deviations of 
pretest S-B IQ scores for the E, Css, Ck and Cj groups at 
each drop out time. The analyses of variance are reported 
in Tables A, B, and C of the appendix. The E and Css groups 
were analyzed by two-way analysis of variance (Drop out t-me 
vs. Subject Group) . The Ck and groups were analyzed 
separately by one-way analyses of variance, since these 
groups were constituted at different grade levels, and there- 
fore must be considered different from the E and Css groups, 
as well as from t^ach other. No significant main effects or 
interactions were fotmd in any of these analyses. 

Table 3 contains the means, n^s, and standard deviations 
of pretest Peabody Picture Vocabulary Test xQ scores for the 
E, Css, Ck and C^ groups for each drop out time. The analyses 
of variance for the PFVT (two-way for E and Css groups, one- 
way for Ck and Ct groups) are reported in Tables D, E, and F 
of the appendix. As was true for the Stanford— Bine t, none 
of the PP^7T analyses yielded any significant main or inter- 
action eff>wGts. It was therefore concluded that attrition 
had no significanu 'Effect (as measured by comparison of pre- 
test S-B and PPV !ores) , on the nature of the subject groups. 
Since attrition axu. not bias the sample, it was possible to 
take advantage of the larger n* s of the early testing periods 
and use all the subjects that '.:ere available for any given 
testing period. 



Pre and Post Test Resixlts 

The Stanf ord-Binet Intelligence Scale (S-Bj_ : As was 

described in the Procedure Section, the S-B was administered 
to the E and Css groups prior to and following prekindergarten, 
at the end of kindergarten, and at the end of the third grade. 
The Ck group was po attested following kindergarten and at the 
end of the third grade. Table 4 contains the means, n’s, and 
standard deviations by Subject Group and Wave for the S-B IQ 
scores at each testing period. Analyses were always 
(Wave X Subject Group) . These analyses are summarized in Table 
5. (See Tables G, H, I, J, K, and L in the appendix for com- 
plete Stanf ord-Binet Analysis of Variance tables) . 

Px^e-Prekindergarten : A sample check was made to 

determine if any pretest differences existed between E and Css 
groups. Table 5 summarizes the 4x2 analysis of variance for E 
and Css pretest scores over four waves (See Appendix Table G) 

No Subject Group main effects were found; this finding was 
corroborated by the part of the attrition analysis that compared 
the E and Css pretest scores (see Appendix, Table A) . However, 
wave effects were found for the S-B pre-prekindergarten analysis 
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Means 5 n’s, and Standard Deviations of the 
Stanford-Binet Intelligence Scale IQ Scores 
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Table M 

Means, n^s, and Standard Deviations of the 
Standford-Binet Intelligence Scale IQ Scores 
for Each Group At Each Testing Period 
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Table 5 

Summary of Analyses of Variance of 
Stanford-Binef Intelligence Scale IQ Scores 
All {3ubject Groups At All Testing Periods 



Testing Period 
Pre-prekindergarten 



Wave (A) 
F 

2.99* 



Subject Group (B) ! AB 

F i F 

<1 i 



Post-prekindergarten | 

Waves X 2 Subject Groups) 



.51 



Po s t-pr ekinder gar ten 
(3 Waves x 3 Subject Groups) 



.. os t-kinder ger ten 



Post Third Grade 



2.15 



2.02 



5.15** 



31 • 82*** 



20.52*** 



31.52*** 



2 . 31 



56 



<1 



1.40 



* p<.05 ** p’*=t .01 *** p <.0001 



C+8) 



o 

ERIC 






(F=2.99; p ^ . 05) . Inspection of the means for the S-B (Table 
4) reveals that the means for the first two waves were higher 
than means for the third and fourth waves. Means for the 
first wave were especially high in contr' "^t to •-ther waves . 

No significant interaction effect was found.. 

Pos t«-prekindergarten : Table 4 shows that, after 

one year, the mean of the E groxip on -che S-B IQ test had 
increased from 92.40 to 99.17, while the control group mean 
changed only from 91.35 to 92.04. 

For this particular testing period, two separate analyses 
of variance are reported: a 4x2 analysis for Css and E groups 

at posnkindergarten over 4 waves; and a 3x3 analysis for Css, 

Ck and E groups in waves 2, 3, and 4. This latter analysis 
(leaving out wave O was done to include the Ck subjects who, 
for the first wave only, were not pretested. 

Table 5 summarizes the 4x2 analysis of va’^iance as described 
above. The Subject Group main effect was highly significant 
(F=31.82; p<.0001). Unlike the pretest analysis, no signi- 
ficant wave effect was obtained. There aloe was no signifi- 
cant Interaction effect. (See also Appendix I, Table H.) 

Table 5 also summarizes the 3x3 analysis of variance for Css 
Ck and E groups across three waves. The results of the 3x3 
analysis were essentially the same as the 4x2 analysis (Table 5) : 
highly significant Subject Group main effect, (F=20.52; p-:i.0001) 
no significant wave effect, and a significant interaction effect, 
(Appendix I, Table 1 ^) 

Orthogonal comparisons were made with the subject group 
means (See Table 6) . While the E group scored significantly 
higgler than the Css and Ck group (p<.05), the control groups 
did not differ from one another. This again supports the 
assumption that the Css and Ck groups are derived from the same 
population. 

Post kx..der.garten : Inspection of the Table of Means 

(Table 4) shows that , while the E group mean is 100.24, the 
means for Css, Ck and Cj groups are 93.00, 92.50, and 84.02 
respectively . 



1. It will be remembered that the Css and Ck groups^ post-pre- 
Icindergarten testing actually took place at the beginning 
of kindergaa-ten in September, while the E group was tested 
at the end of the prekindergarten year .in May. 
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Table 5 summarizes the 4x4 analysis of variance of S-B 
IQ scores for the E, Css, Ck and Cn groups. 2 Only the Subject 
Group main effect was significant (^=31. 52; p^.OOOl). Ortho- 
gonal comparisons (Table 6) showed that the £ group scored 
significantly higher than the combined Css-Ck group (p<.01)„ 
as well as higher than the group (p < . 01) . The combined 
Css-Ck group scored significantly higher than the Cj^ groi^p 
(p < .01). (Appendix I, Table J.) 

Post Thi r d Grade : Table 5 summarizes the 3x4 
analysis of variance of post third grade sceras for E, Css, 

Ck and Cj^ groups over waves 1-3. (See Appendix I, Table K.) 

Wave was found to be a significant main effect (F=5.15; 
p . 01) The xrave effect seemed to be primarily a result of 
the relatively low performance of the second wave. (See Table 4) 

Subject Group did not reach the p<^ .OS level of signifi- 
cance (F=2.31; p<.0S). Folj. owing Winer^s suggestion (1952), 
however, orthogonal comparisons were nevertheless applied to 
the subject group differences (TaZole 6) . The £ group score . 
significantly higher than the Cj^ group. 

The Peabody Picture Vocabulary Test fPPVT l : The PPVT 

was administered to the same subject groups at the same test 
periods as the S-3. Table 7 contains the means and standard 
deviations by Subject Group and Wave for the PPVT IQ scores 
at each test period. Again, two-way analyses of variance 
(Wave X Subject Group) were used. These analyses are summarized 
in Table 8, and completely reported in Appendix I, Tables L, M, 
and 0 . 



Pre-prekindergarten : Table 7 summarizes the 4x2 

analysis of variance for the E and Css groups at pretest. N 
significant subject group differences are apparent. The PPV± 
attrition analysis (Table 3) corroborated the fact that no 
sign.ificant differences existed between the Css and F. groups 
at px,'et3st on this measure. (Appendix I, Table 0.) 

However, as was true for the S-B, a wa c effect was found 
(?=4.17; p . 01) . Again, inspection of the means (Table 7) 
Slowed that the means t'or the first two waves were higher than 
t.iose for tht third and fourth waves; means for the first wave 
were again found Le especiaJ.ly high in contrast to other 
waves . 



2. pretest scores were considered as comparable to E, Css, 

and Ck postkindergarten scores „ 
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Mean PPVT Scores 
At Each Administration 
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Total 265 
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of unr-ichmant the E group mean was 31.67 and the means for the Css, - 
Ck groups were 72,38 and 72.82 respectively. 

Table 8 siommarizes the 4x3 analysis of variance of the post- 
prekjL.idergarten PPVT scores for E, Css, and Ck groups (see footnote 
1) in wav ’F 1~4. Subject Group was found to be the only signifi- 
cant rf-ect (F=14,83; p'«;:.0Q01), (Appendix Table M) 

C' cl: . gonal comparisons of the subject group means (Table 9) 
showed that the E group scored significantly higher than the com- 
bined Css-Ck group (pC^.Ol). As in the Stanf ord-Bine t the Css and 
Ck groups did net differ from each other and therefore may be con- 
sidered as deri\'ed from the same population. 

Post Kindergaiten : Table 7 shows that, after two years 

of enrichment, the E group mean on the PPVT was 87.76; the means 
for the Css, Ck and groups were 80.96, 81.06 and 74.03, respective!; 

Table 8 summarizes the 4x4 analysis of variance of the post- 
kindergarten PPVT scores for E, Css, Ck and C^ groups (see footnote 
2‘J in waves 1-4. Again, the Subject Group main effoct was signif- 
icant (F=16.33; p< .0G01). Wave was also found to a significant 
main effect (P=3l56; p<.05). Examination of rhe PPVT means 
(Table 7) showed that, once again, the means for the first two waves 
were higher than those for the third and fourth waves; the first 
wave mean was especially high in comparison to the others. (Appendix I 
Table N) 

Orthogonal comparisons of the Subject Group means (Table 9) 
showed that the Subject Group main effect can be explained by the 
fact that the E group scored significantly higher than the Css-Ck 
groups combined (p<(.01) as well as higher than the Ci group (p<(,01). 
The Ct^ group scored significantly lower than the Css-Ck group (p <(. 01) . 

Post Third Grade : Table 7 shows that after five years 

of enrichment, the E group PPVT IQ, mean was 92,73, while the means ^ 
for the Css, Ck and. C^ groups were 85.08, 90.86 and 85.25, respective! 

Table 8 summarizes the 3x4 analysis of variance for the 
post third grade PPVT scores of E, Css, Ck and Ci groups in waves 1-3. 
As in the prev'ious analysis on the PPVT, the Subject Group main 
effect reached significance (F=3.36; p<(.05). Orthogonal comparisons 
(Table 9) of the Subject Group means showed the difference to be 
entirely attributable to the superiority of the E group (^. C.05). 
(Appendix I, Table O) 

The Lorge -Thorndike Group Intelligence Test (X-T) : The Eorge-Thorn- 

dike test was given to all subject groups at the end of first and 
second grades. Table 10 contains the means, n^s, and standard 
deviations by subject group and wave for L-T IQ scores at fir.'st and 
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Table 8 



Summary of Analyses of Variance of 
Peabody Picture Vocabulary Test 
All Subject Groups At All Testing Periods 



Testing Period 
Pre-prekindergarten 



Wave (A) 
F 

M.17** 



Subject Group (B) 
F 

2.87 



Post~prekindergarten 



2.0ij 



IM . 83*** 



Post-kindergarten 



3.59* 



16.33*** 



Post Third Grade 



1.75 



3.36* 



* p<. 05 ** p-<.01 *** p<. 0001 
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Orthogonal Comparison of Subject Groups 
For Peabody Picture Vocabulary Test Scores 



CM 

O 



o 

•H 

CO 

d 

a 

a 

o 

CJ 



Ph 



r^l 

CJ 

II 

w 



o 

1X5 



pH 

« 

u 


tH 

CJ 

/N 

w 






5« 






CM 






• 


0 


CD 


CX) 


CD 





+ 

CO 

CO 

CLJ 

II 

w 



o 



c 

o 

•H 

CO 

d 



o 

CLJ ; 



PM 



+ 

CO 

CO 

CJ 

.A 

w 


ij 

+ 

CO 

CO 

CJ 

II 

W 


+ 

CO 

CO 

CJ 


t) 

CO 

W 




“ • « 








o 




4: 




PC 


cn 


m 


cn 




o 


tn 


iH 




o 


• 


• 




cn 


Ul 


CD 




rH 




m 









n 

CO 

CO 

CJ 



o 



o i 




•H ; 


ri< 


CO i 


CJ 


d ' 


II 


rH • 


CO 


O 


CO 


d • 
o ^ 

CJ ^ 


CJ 



Pm 



rcj 

o 

•H 

U 

0) 

PM 

+J 

CO 

0) 

H 



i-M 

V 



d 

0) 

+j 

bO 

SM 

0) 

d 

•H 

0) 

£ 

+J 

CO 

o 

PM 



CJ 

+ 

CO 

CO 

CLJ 



CJ 



O 



+ 

CO 

CO 

CJ 

CJ 

❖ 

❖ 

CNJ 

lO 

9 

rH 



CJ 

4- 

co 

CO 

CJ 

CJ 



CM 



d 


CU 




cu 


nd 




4-J 


cd 




u 


d 




cn 


CD 




bo 

d 




i~l 


CU 




O 


•XU 


•H 


• 


d 




V 


•H 


en 








Tj 


+J 




CO 


CO 




o 


o 


PM 


PM 





ERIC 






58 



Means, n’s, and Standard Deviations of the 
Lorge-Thorndike Group Intelligence Test Scores 
for Each Group At Each Testing Period 
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second grades.^ Separate 4x4- analyses of variance (V7ave x Subject 
Group) v?ere performed at each grade level for E, Css 5 Ck and C 2 ^ su 
jects in waves 1-4. These analyses are summarized in Table 11. 

(See Tables P and Q in Appendix I for complete tables.) 

F irst Grade : Table 10 shows that after three years of 

enrichment, the E gr^up had a mean of 93.41, while Css, Ck and C-^ 
groups had means of 89.34, 90.17 and 86.40, respectxvely . 

Analysis of variance was performed on L-T scores at the end of 
first grade for all subject groups for four waves (Table 11 and 
Appendix I, Table P) . Both wave (F=4.36; p<-.01) and Subject Group 
(F =8 26; p<.0001) were the main significant effects- The inter- 
action of Wave X Subject Group did not reach the p-.05 level o± 
significance. 

From inspection of the Table of Means (Table 10) , it a^ears 
that the Wave effect is attributable to the high score of the fxrst 
wave. Orthogonal comparisons of the subject group means (Table 12) 
revealed that the E group scored significantly higher than the 
combined Css-Ck group (p<.01) as well as the ^ nn 

The Css-Ck group scored significantly higher than the Cj^ group (pv,. ) 

Second Grade : Inspection of the second grade means shown 

in Table 10 shows that, while the mean for the E group 
the means for the Css, Ck and C^ groups were 88 . ro, 88.01 and 85.53, 

respective ly . 

A two-way analysis of variance (Wave x Subject Group) was per- 
formed on L-T scores for all subject groups over waves 1-4 (Table 11 
and Appendix I, Table Q) . At second grade only the Subject Group 
main effect was significant CF=4.51; p< .005) Howe ver t he Wove 
X Subject Group interaction term was found to be close to signx 
cance, (F=1.88; p<.06). 

Orthogonal comparisons were applied to the bject groi^ 

(Table 12). The E vs. Css-Ck comparison was s: ^ticant (P^ > 

as was the E vs, Ct comparison (p<.01). The f vs. Css Ck i " 

ferLce was also significant (p<. 02 ). The dir .tion of differences 
was the same as for grade one, favoring the E .oup. 

The Reading Prognosis Test (RPTj_ : The Reading Prognotais Test w^s 

administered to ail~subject groups at the end of kindergarten 
Table 13 shows the means and n^ s for all E, Css, and Ck s^t)je 
across four waves. The E group means was 28.22, while the Css 
and Ck groiip means were 23.74 and 22.84, respectively. 



3. It should be noted that the small n in wave 4 was due to the 
inaccessibility of subjects, which resulted from the difficul les 
which beset some of the schools during the end ot the 1968-69 
school year. 
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Table 11 



Summary of Analyses of Variance of 
Lorge-Thorndike Intelligence Tests 
For All Subject Groups At First and Second Grades 



Testing Period 
First Grade 



Wave (A) 



F 

4 . 36* 



Subject Group'CB) AB 

F F 

8.26** <1 



Second Grade <1 



H , S j. 



1 . 



o r> 
O C. 



* p ^ . 01 



** p <.0001 
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Orthogonal Cotnparison of Subject Groups 
For Lorge-Thorndike Group Intelligence Teat IQ Scores 
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A two-way analysis of variance — Wave x. Subject Grcup — sum- 
marized in Table 14 (completely reported in Table R of Appendix I) 
was performed bn RPT scores for all groups over four waves. Sub- 
ject Group was shown to be a significant main effect (p^.005) . 

A significant wave effect was also found (p<.05), A significant 
interaction was found (p^.0Q5) . The wave effect seems to be a 
result of the fact that higher scores were obtained by wave 1; 
this difference is consistent with the data obtained on initial IQ 
differences between the waves, as discussed above. 

Table 14 

( 1 ) 

immary of Analysis of Variance of Reading Prognosis Test Raw Scores 
for All Es Css, and Ck Subjects by Wave and Subject Group 



Source 

Subject Group (A) 
Wave (B) 

AB 



F 

14.38** 

2 . 86 * 

4.31** 



*p < .05 

**p .01 

A simple effects analysis is sijmmarized in Table 15 (completely 
reported in Appendix I, Table S) . Subject Group effect occurred in 
wave 1, while the direction of the difference in favor of the E 
group was apparent for all waves. 

Table 15 

Summary of Analysis of Simple Effects for Reading 
Prognosis Test on E, Css, Ck Over Four Waves 



Source 



B for A-i 


(E) 




A2 


(Css) 




A3 


(Ck) 




A for B, 


(Wave 


1) 


B2 


(Wave 


2) 


B3 


(VTa.ve 


3) 


B4 


(Wave 


4-) 



*p <.05 

**p < . 01 

O 
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*■ i 

arj 



F 



6,89** 

3.16** 

1.43 

21.70* 

2.79 

2.13 

1.22 



Orthogonal comparisons (Table 16) shawec. the E groups as 
scoring higher than the combined Css-Ck group. The Css and Ck 
groups did nob differ from each other. 

Table 16 

Orthogonal Comparison of Subject Groups Over Four 
Waves for Reading Prognosis Test 



Ho: E=CktCss 



F-Ratio 



Conclusion 



Waves 1* 2, 3 and 4 53.88 



E> Ck+Css 



The Metropolitan Achievement Tests — Reading Subtest (MAT P.eading) ; 

The Metropolitan Reading Test was administered by the Board of Educa- 
tion to second and third grade children in all the public schools 
of New York City. The test is administered either in March or April. 
(Grade level norms are therefore 3.7 and 2.7). The Metropolitan 
Reading Test has two parts: Word Knowledge and Reading. Analyses 

of variance were always two-way (Wave x Subject Group) . These 
analyses are summarized in Table 18, and are completely reported in 
Tables T, U, V, and W. 

second Grade Word Knowledge : Table 17 shows the mean 

equivalent scores for the Word Knowledge subtest at second grade 
for all Subject groups over three waves (waves 2, 3, and M) . Scores 
for children in wave 1 were not availabJ-e, as the schools from which 
we obtained the scores did not give the test to those children. 

The analysis of variance, summarized in Table 18 (completely 
reported in Appendix I, Table T) showed a significant Subject Group 
main effect (F=2.92; p <;.05) and no significant wave effect. No 
significant interaction effect was found. 

Orthogonal comparisons (Table 19) showed that the E group was 
significantly higher than the group (p<.01), but not significantly 
different from the combined Css-Ck groip. The C]^ group was signifi- 
cantly lower than the combined Css-Ck group (p<.01). 

In addition, comparison was made between the E group scores 
and the mean grade equivalent scores for those schools in which 
the IDS program operates (see Table 20) . Also reported in Table 20 
are the results of t test analyses which were performed to compare 
the E group mean to the mean of school norms (waves 2. 3, and 4 com- 
bined). The E group was found to be significantly higher than the 
average of the school norms (p^ .001; one-tailed test) . 

Third Gra.de Word Knowledge : Table 17 shows the mean grade 

equivalent sl^ores ifor Word Knowledge for all subject groups over the 
first fhree waves. 
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Total 84 i 3.S2 j .85 36 3.30 .81 I 6 1 3.35 1.39 62 ^^11 



Table 17 (con^t) 





C65) 68 



Table 17 (con't) 
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Problem Solving and Concept Subtest 
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Table 18 



Summary of Analysis of Variance of 
Metropolitan Achievement Test Scores for 
All Groups at Second and Third Grades 





Readinja: 


Sub test 




Arithmetic Subtest 




Reading Word Knowledge 


Problem 


Solving Computations 


Source 


Second 


Grade 








F 


F 


F 


F 


Wave A 


1.98 


<1 






Subject 


2:12 


2.92 






Group B 
AB 


<1 


1.09 








Third 


Grade 




2.95 


Wave A 


2. 6M 


M.09 


5. OM 


Subject 


1. 65 


1.79 


1.63 


1. 8M 


Group B 
AB 


<1 


<1 


<1 


1.10 
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Orthogonal Comparison of Subject Groups 
For Metropolitan Achievement Test Knowledge 
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Orthogonal Comparison of Subject Groups 
For Metropolitan Arithmetic Test 
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Table 20 



Mean Grade Equivalen- Scores and t Ratios 
Obtained for Metropolitan Achievement Tests 
Reading and Arithmetic Subtests 



Wave 



Group 

Schools wlL’h 
Institute Classes 



2nd grade word knowledge* 



2 

3 

M 



2. M 

2. 5 



2.7 

2.8 
2.6 



3rd grade word knowledge** 



1 

2 

3 



3.1 

2.9 

3.1 



3. M 
3. M 
3.8 



2nd grade reading*** 



2 

3 



2. M 
2.M 
2.5 



2 6 
2.6 
2.6 



3rd grade reading**** 



1 

2 

3 



3.2 3.3 

3.1 3 .'- 

2.9 



3rd grade prbblem solving and 



concepts***** 



3. M 
3. M 
3.7 

3rd grade computation 

3.0 
3.0 
3. M 

* t=3. 7 5 p •< . 001 (ore tailed) ** t=5.5 3 p . 001 

**t?; rs=2.50 p<.01 **** t=2 . 7 3 p<.005 



1 

2 

3 



3.1 

2.9 

3.1 



1 

2 

3 



3.2 

3.1 

3.2 



****** t=^3.30 p<.001 
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The analysis of variance, summarized in Table 18 (complr"'ely 
reported in Appendix I, Table U) showed a significant wave effect 
(F=4«09; p<.02) and no significant Subject Group effect. 

Examination of the table of means (Table IV) showed that the 
mean for the second wave was higher than that for the first wave; 
furthermore, the mean for the third wave was greater than that for 
the second wave. No significant interaction was found. 



Orthogonal comparisons (Table 19) showed the E group to be 
significantly higher than the C-j^ group (p<^„05). Although the E 
group scored higher than combined Css-Ck group (see Table 17) the 
difference did not reach significance. No significant difference 
was found between the group and the combined Css-Ck group. 



Table 20 shows the third grade mean equivalent scores of the 
schools where IDS had its demonstration program. In all cases, the 
mean of the E group was higher than the overall school mean, and 
was almost at grade level. Table 20 shows the ^ tests that were 
done to compare the E group grade equivalent scores for the combine 
first three waves with the overall school mean for that time perioc 



The E group mean was significantly higher than the school mean 
(p<.001; one-tailed),^ 



Second Grade Reading : Table 17 shows the mean grade equ; 

alenr scores for second grade reading for all subject groups ove 
three waves (waves 2, 3, and I) . 



The analysis of variance (see Table 18 and Table V of Appendix 
showed no significant wave or subject group main effect differences 
and no significant interaction effect. Examination of the table oJ 
means (Table 17) showed that the Ck groups scored slightly higher 
than the E or Css groups. Orthogonal comparisons (Table 19) showec 
no differences between the E and combined Css-Ck group. The E 
group scored significantly higher than the C group (p<C.*05), the 
Css-Ck group also scored significantly higher than the C^ group (p 

Table 17 shows the mean grade equivalent scores for the schoo. 
where IDS had its demonstration classes. The E group mean was 
higher than the means of all the school norms at every wave; the 
E group mean was close to or at grade level. Table 19 shows _t tes^ 
that were done to compare the E group mean to the average of schoo. 
norms for waves 2, 3, and 4 combined. The E group scored signif- 
icantly higher than the schooJ. norm (p<;.01; one-tailed test). 



4. The t_ test used in this analysis, as well as in the other 
Metropolitan Achievement Test analyses involved comparing the ob- 
tained mean of the E sample with an expected mean, the overall 
school mean. See Peatman, 1963. 
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Third Grade Reading; : Table 17 shows the mean grade equiv- 
alent scores for third grade reading for E» Css, Ck and C]^ groups 
over the first three waves. 

The analysis of variance (see Table 18 and Table W of Ap- 
pendix I) ^showed no significant subject group or wave differences 
and no significant interaction effect. The table of means (Table 
17) shows that, as in the Word Knowledge subtests, the E group 
scored higher than all other groups. Orthogonal comparisons 
(Table 19) showed the E group to be significantly higher than the 
combined Css-Ck group (p<.C5) and also higher than the group 

(p <,02). 

The E group mean grade equivalent score was higher than the 
average of the school norms (see Table 20) . Again t tests were 
done to compare the E group to the school norm for the combined 
first three waves (Table 20) , The E group had a significantly 
higher score than the school norm (p<^,005; one-tailed test). 

Metropolitan Arithmetic Test : The Metropolitan Aritlimetic Test wa. 

administered by the Board of Education to third grade children in 
all the public schools of New York City. The test was given in 
March or April. (Grade level was 2.7 and 3.7.) The test has two 
parts: Problem Solving and Computation. 

Third Grade Problem Solving and Concepts : Table 17 show 

the mean grade equivalent scores for the Problem Solving subtest 
for E, Css, Ck, and C-j^ groups over the first three waves. 

In the analysis of variance (Table 18 and Table X of Ap- 
pendix I ) 5 wave was found to be the only significant main effect 
(F=5.01; p<.01). The wave effect was a result of the high scores 
at wiive 3 for all groups. Inspection of the means (Table 17) show 
that the main effect of wave was a result of high scores at wave 
3 for all groups. In fact, the mean of the E group for wave 3 was 
hig;her than that for wave 2; moreover, the mean for wave 2 was hig 
than that for wave 1. The E group mean was somewhat higher than 
the means for all other groups; the differences did not reach 
signif icance . 

Orthogonal comparisons (Table 19) showed the E group to be 
significantly higher than the C-j^ group (p<].05). No significant 
differences were found between either the E group and Css-Ck gi'oup 
or between the Css-Ck group and the C^^ group. 

Table 20 shows the mean grade equivalent scores for the E gro* 
and the mean grade equivalent scores for the schools in which the 
IDS program operated. Again, t tests (Table 20) were done to com- 
pare the E group mean with the mean of school norms for the combin 
wa\^es 1 to 3. The E group mean was significantly higher than the 
average of the school norms (p<^.001; one-tailed test). 
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over the first three waves. 



The analysis of variance (see Table 18 and Table Y of Appen- 
dix I) showed no significant interaction effect. Examination of 
the means (Table 17) shows the Css and Ck groups to be slightly 
higher than the E groups. 

Orthogonal comparisons (Table 19) showed no significant differ- 
ence between the E group and combined Css-Ck group. There was no 
significant difference between the E group and C group. The 
group was significantly lower than the combined css-Ck group. 

Table 20 shows the mean grade equivalent scores for the E group 
and the mean grade equivalent scores for the schools where IDS had 
demonstration classes. At wave 1 the school norm was slightly 
higher than the E group. At wave 2 the E group was slightly hxgher. 
Again, t tests, comparing the E group to the school norm for the 
combined waves 1-3 (Table 20), showed no significant differences. 



The Illinois Test of Psycholinguistic Abilities (ITHQ, : The Illinois 

Test of Psycholinguistic Abilities— 1961 version— was given to E 
and Css children in the first wave at the fxrst, second and thxrd 
grade levels. Six subtests of the 1968 version of the ITPA vieve 
given to the following E and Ck children: waves M- and 5 at '^hi^ 

grade; waves 5 and 6 at second grade; and wave 6 at first grade. 

The mean standard scores for each of the nine subtests, as well as 
for- the total test, of the 1961 version are shown in figures 1-9-. 
Separate four-way analyses of variance (Subject Group x School x 
Sex X Grade) with one repeated measure (Year) were computed tor each 
subtest, as well as for the total test. These analyses are sum- 
marized in Table 21, and completely reported xn Appendxx I, Tables Z, 
AA, BB, CC, DD, EE, FF, GG, HH, and II. 



Table 21 summarizes the analysis of variance for the total 
score of the 1961 version (Appendix I,, Table Z) , Only Subject Group 
was found to be a significant main effect (F=9.q3; p < 01) . in- 
spection of the means (see figures 2-4) showed the dxfference be- 
tween the E and the Css groups to increase with each successxve 
grade level. 



Subject Grcuap was also found to be a significant main effect 
on six of the nine subtests. Those subtests on which Subject Group 
did not differentiate between groups were: (1) Audxtory Decodxng; 

(2) Auditory-Vocal Sequential; and (3) Visual Motor Sequentxal 
(Table 21 and Appendix I, Tables AA, . FF, GG) . Inspection of the means 
(figures 2-4) showed that all the differences could be accounted 
for by the higher mean score of the E group. Moreover, inspectxon 
of the means revealed that the E group had a higher mean score than 
the Css group on: all nine subtests at third grade, all 

subtests at second grade; and eight subtests at first grade, ali 
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Fi 2 ure 3; Ns and Means for Illinois Test of Psyoholinguistio 
Abilities (1961) Subtests and Total Test (Grade 2)* 
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Pisure M-: Ns and Means for Illinois Test of Psyoholinguistic 

Abilities (1961) Subtests and Total Test (Grade 3)* 
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except Vocal Encoding, (Table 21 and Appendix I, Table HH) . 

The main effect of School^ for the three grades combined only 
reached significance (F=5.98; p<.05) for one subtest (Auditory- 
Vocal Automatic — see Table 21 and Appendix I, Table EE) . Sex was found 
to be a significant main effect only for the Visual Decoding sub- 
test (F=12.70; p<.01) — see Table 21 and Appendix I, Table^ BE. Grade 
the repeated measure was found to be a significant main “effect for 
seven of the nine subtests (all except the Auditory-Vocal Associa- 
tional and Auditory- Vo cal Sequential subtests--see Table 21 and Ap- 
pendix 1 , Tables Aa", BB, DD, EE, GG, HH, and II — footnote 5, above) . 

Significant interactions were obtained on five of the nine sub- 
tests. (See footnote 5 above.) On the Vocal Encoding subtest. 

Grade significantly interacted with Subject Group (F*=9.31; p^.Ol). 
Table 21 and Appendix I, Table, mr Referring to the means (figures 2^ 
3) it appeared that the E group ott;tined its highest mean standard 
score at second grade, while tuiu Css group scored its iiighest mean 
standard score at first grade. The only other significant inter- 
action effect involving Subject Gr:Z 2 'j.p and Grade occurred for the 
Motor Encodi_ng subtest (F=4.91; p <' -01). See Table 21 and Ap- 
pendix I, Table II. 

The n^s and means are shown i.i figures 5-8 for the revised ITPA 
subtests (1968) . Separate two-way analyses of variance (Subject 
Group X Grade) were computed for each of the six subtests as well 
as for their total score (see Table 22 and Appendix I, Tables JJ, KK, 
LL, MM, NN, 00, PP) . 

On the total test. Subject Group was a significant main effect, 
with the Es scoring higher than the Ck group (F=8.65; p<.005)„ The 
main effect of Grade was also significant (F=3.71; p<.05). From 
the means shown in figures 6—8, it appeared that the second grade 
scores were somewhat lower 'than the first and the third grade scores. 
No significant interaction effect was obtained. 

Significant Subject Group main effects (at least at the p< .05 
level) were found on three of the six subtests; Visual Reception 
(F=5.07; p<.05); Auditory Association (F==8.38; p<T. 01); and 
Sound Blending (F=15.80; p<.01) — see Table 22 and Appendix I, Tables 
I/L, MM, 00. The direction of the differences was in favor of the 
E groups (see Figures 5-8) . 

The main effect of Grade was also found to be significant (at 
least at the p^.05 level) for three of the subtests: Auditory 

Association (F=^.47; p<.01). Visual Association (F=3.60; p<.05). 



5. School and Sex variables will not be considered here, as these 
variables were not calculated for the other analyses. ^ fuller 

discussion of these results, see C. Deutsch, et. al., 19/0, 
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Table P.l 



Summary of the Analysis of Variance Tables 
of the Illinois Test of Psycholinguistxc Abilities (1961 
edition) Scores for Males and Females from Two Schools, 
under Two Treatments, over Three Years of Testing 



Sourc<^ 

Subject School (B) Se> (C’ '" "jideCD) Signif leant 

Group (A) Inreraction 



F 


F 


F 


F 


Type F 


Total Test 9. M3** 


< 1 


<1 


<.JL 


none 


Auditory 

Decoding Subtest 1.86 


<1 


1 

l.M? 


M.7-'^ 


none 


Visual 








AB 5.82* 


Decoding Subtest 7.31** 


<1 1 
1 


12. 7 D* 


6. 


BD 5.9 2** 


Auditory- Vocal 5.72* 

Association 

Sub test 


<1 


<1 

i 


<1 


CD M.25* 


Visual-Motor 
Association 6. MM* 

Sub test 


1. 23 


<1 


M. 89** 


none 


Audi tory-Vocal 
Automatic Subtest5.27* 


5. 98*i 


<1 


7. IM** 


none 


Auditory- Vocal 
Sequential Subtest 1 


<1 


<1 


<1 


none 


Visual -Mo tor 
Sequential Subtest 1.20 


<1 


<1 


10.11 


AC 6.13* 


Vocal 5. MM* 


<1 


2.77 


3. MO* 


AD 9.31** 


Encoding Subtest 








CD 3.29* 
BCD 3.1M* 


Motor 

Encoding Subtest 11.91** 


3. 13 


2.36 


12. 72** 


jAD M.91** 



I 



* p < . 05 ** p < .01 
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Score 



38 



37 

36 

35 



3^ 



33 



32 



31 



30 



29 

28 

27 



26 



25 



2M- 

X 



Fiscure 5: Ns and Mean Scaled Scores for Six Subtests of the Illinois ^Test 

of Psycholinguistic Abilities (1968) for Grades 1-3 combined, (n ■ 60) 
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Figure 6; Ns and Mean Scaled Scores for Six Sxibtests of the Illinois Test 
of Psycholinguictic Abilities. (1968) for Grade X. (n * 20) 
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i. 7 ; Ns arc ■■ean Scaled Scctt- 'S for Six Subtests of the Illinois Te n 

cx Psycholinguis Abilities (196 £ j for Grade 2. (n * 20) 
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Figure 8 : Ns gnd Mean Scaled Scores for Six Subtests of the Illinois Test 

of Psychollnguistic Abilities. (1968) for Grade 3. (n = 20) 
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Table 22 



Summary of the Analysis of Variance Tables 
of the Illinois Test of Psycholinguistic Abilities (1968 
edition) Scaled Scores on E and Ck Subjects at First, 

Second and Third Grades 



Source 





Subject 
Group (A) 


Grade (B) 


AB 




F 


F 


F 


Total Test 


8,65*** 


t 

3.71* 


<I 


Auditory 


2.50 


<1 


1. 35 


Reception Subtest 






Visual 


5.07* 


1.66 


9 


Reception Subtest 






Auditory 
Association 
Sub test 


8.38** 


5.97** 


1.59 


Visual 
Association 
Sub test 


<X i 

i 


3.60* 


1.59 


Sound Blend 
Subteat 


i 

1 

15.80** 1 


5.3M** 


21.76 


Visual 

Closure Subtest 




i 

<1 


1.01 



* p<.05 ** p<.01 *** p<.005 
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and Sound Blending (7=5.34; p<.01)-~see Table 22 and Appendix I, Tables 
MM, NN, 00. In all three cases second grade standard scores were 
lowest. No significant interaction effect was found for any subtest. 

Early Childhood Inventories : A group of inventories, which tap 

specific abilities and particular curricultun elements, was given to 
two waves of E children, and to their Ck controls, at the end of 
kindergarten. N’s, means, and standard deviations for the E and Ck 
groups, over the fifth and sixth waves are shown in Table 23. The 
inventories were subjected to separate two~way analyses of variance 
(Wave X Subject Group) . These analyses are summarized in Table 24, 
and completely reported in Appendix I, Tables QQ, HR, SS, TT, UU, W, 

WW, and XX. 

Alphabet Name Inventory (ANI/PUC) : Table 23 shows the 

n’s, means, and standard deviations for the E and Ck groups over two 
waves. Analyses of variance yielded no significant main effect or 
interaction (see Table 23, and Appendix X, Table QQ. Inspection of 
the means (Table 23) , showed that, for both waves, a non-significant 
trend appeared, showing the E group to score somewhat higher. 

Body Parts Name Inventory (BPNI) : Table 23 shows the n’s, 

means, and standard deviations^ for the E and Ck groups over two 
waves. Analysis of variance showed the groups to differ signifi- 
cantly (see Table 24 and Appendix I, Table RR) , at the p^.05 level 
(F=6.87) the Table of Means (Table 23), showed that the source of 
the difference is due to the highe . scores of the E group. The main 
effect of wave, as well as the Wave x Subject Group interaction, 
were not significant. 

Numeral Name Inventory - 1 (NNI-1) : Table 23 shows the 

n’s, means, and standard deviations for the E and Ck groups over 
two waves. Analysis of variance indicated that no significant dif- 
ferences existed, on aither the wave or Subject Group main effects 
(Table 24 and Appendix I, Table SS) . Inspection of the means (see 
Table 23) showed that the direction of the difference was in favor of 
the E group, although for wave six the means were virtually identical. 
No significant interaction occurred here either. 

Quantity Matching Inventory (QMI) : Table 23 contains the 

n’s, means, and standard deviations for the E and Ck groups over 
two waves. As in the ANI/PUC and NNI-1 no significant main effect 
of interaction was obtained (see Table 24 and Appendix I, Table TT) . 
Again, a trend appeared, with the direction of the trend in favor 
of the E group. 

Relational Concepts Inventory/Pre-Mathematics (RCI/PM) : 

Table 23 lists the n’s, means, and standard deviations for the E 
and Ck groups over two waves. Analysis of variance indicated a 
significant Subject Group main effect (F=8.68, p-C.Ol). No signi- 
ficant wave effect or i.nteraction was obtained (Table 24 and 
Appendix I, Table UU) . Inspection of the means on Table 38 indicated 
that the E group scored higher. 
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Table ^3 



Means, N’s, and Standard Deviations of 
Early Childhood Inventories Postkindergarten Scores 
for E and Ck Subjects in Waves 5 and 6 



Wave 



E 



Alphabet Name Inventory 

Ck 





N 


X 


S.D. 


N 


X 


S. D. 


5 


28 


Ml. 86' 


9.80 


' 1 

10 I 


i 

i 3M. 80 


16. Ml 


6 


M2 


39,69 


15.30 


i 


37.58 


16.89 


Total 


70 


MO. 56 


13. 33 


|29 


36.62 : 


16. M9 








Body 


i 

Parts Inventory 






5 


28 


20. 39 


2. 33 


I 10 


17. MO 


M.OO 


6 


M2 


18.95 


3.01 


jl9 


18.26 


M. 73 


Total 


70 

1 


19.53 


2.83 


|29 

i 


17.96 


3. 6M 




i 

1 


i 


Nume 


iral Name Invento 


ry 




5 


28 


30. 78 


7.99 


10 


23. 20 > 


1M.83 


6 


M2 


26.50 


12. M3 


' 19 ; 


26.21 


13.25 


Total 


70 


28.21 


11.01 


! 29 


25.17 


13.63 








Qnari 


i 

itity Matching In 


ventory 


5 


28 


13.57 


2.92 


ilO 


12.50 


3.8M 


6 


Ml 


13.17 


I 2.67 


1 19 


11. 8M , 


3.0M 


Total 


69 


13.33 i 


1 2.76 


; 29 


12.07 , 

1 


, 3. 28 

1 






Relations 


1 

[1 Concepts-Pre-M 


ath Inv 


entory 


5 


28 


16.75 


1.50 


10 


1M..60 


1.77 


6 


M2 


16.12 


2.35 


19 


15. M2 


; 2.50 


Total 


70 


16.37 


2.03 


29 


. 5.1M 


, 2. 28 

; 






Relational 


Concept s-Pre-Sci 


1 

ence Inventory 


5 


28 


18.18 


1.M6 


10 


16.90 


' 3.21 


6 


M2 


17.88 


1.86 


19 


17.26 


: 1.56 


Total 


70 


18.00 


1.71 


29 


17. IM 


2. 21 






l 

Set Mat 


:ching Inventorv 






5 


28 


11. IM 


1. 38 


1 >10 


9.90 


3.35 


6 


M2 


10.93 


1.7M 


il9 


9.63 


i 2.21 


Total 


70 


11.01 


1.60 

1 


;29 


9.72 

i 


1 2.60 






Shape In 


fame Inventory 


i 

i 




5 


28 


13. M6 


2. 27 


1 


! 11.90 


1 3.57 


6 


M2 


12.86 


2.86 


! 19 


! 11. M2 


i 3.7M 


Total 


70 


13.10 


2. 6M 


i 29 

1 


j 11. 59 


3.63 
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Table 24 



Summary of Analysis of Variance 
Early Childhood In entories Scores 
For E and Ck Subjects by 
Pretest and Post Test 



Source 

A(pre and post) B (subject group) AB 





F 


F 


F 


Alphabet Name 
Inventory 


<1 


[ 

1 


! 

1.91 ! 

1 ; 

1 : 


<1 


Body Parts Name 
Inventory 


<1 




( 

6.87* I 

j 


2.65 


Numeral Name 
In entory 


<I 


2.10 


1.80 


Quantity Matching 
Inventory 


<1 


3.12 1 


<1 


Related Concepts 
Inventory-Pre-Math 


<1 


8.68** : 


2.22 


Related Concepts 
Inventory-Pre-Science 




M.83* ■ 


<1 


Set Matching 
Inventory 


<1 


7.9M** i 


3.38 


Shape Name Inventory 


<1 


9.78* 


<1 



* p ^ . 05 ** p <.01 
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Relational Concepts Inventory/Pre-Sclence CRCI/PSli ; 

Table 23 shows the means, n’s, and standard deviations for the E 
and Ck groups over the two waves. Analysis of variance showed the 
Subject Group main effects to be significant (F=4.83; p<.05). 

No significant wave effect or Wave x Subject Group interaction was 
obtained (Table 24 and Appendix I, Table W) . As can be seen in 
Table 23 the significant effect is due to the higher scores of the 
children. 



Set Matching Inventory (SMI') ; N’s, means, and standard 
deviations for the E and Ck groups over the two waves are listed 
in Table 23. Once more, analysis of variance (Table 24 and Appen- 
dix I, Table WW) revealed only a significant Subject Group main 
effect (F=7.94; p<.01). The difference again was due to higher 
E group scores. 

Shape Name Inventory (SNI*) : Table 23 shows the n’s, 

means, and standard deviations for the E and Ck groups over the 
two waves. As in the BPNI, RCI/PS, and SMI, analysis of variance 
(Table 24 and Appendix I, Table XX) revealed orily the Subject Group 
main effect to be significant (F=4.78; p<^.05). The direction of 
the difference again indicated E group superiority. 
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QUALITATIVE EVALUATION 



In addition to the quantitative results just presented , the 
Institute has gathered information of a qualitative nature, 
which provides another measure of the relative influence of the 
program. This qualitative Information has been culled from 
anecdotal records, open-ended interviews, unsolicited letters 
written to the Institute, questionnaires, observers^ records, 
etc. These evaluations will be summarized below. 

An index of attitudes of school administrators toward the 
IDS program was obtained by Interviewing four principals and 
five assistant principals. These interviews (conducted in the 
1967-1968 school year) consisted of open-ended, unstructured 
discussions with the Early Childhood Coordinator for the district^ 
the administrators were interviewed one at a time. All the ad- 
ministrators interviewed expressed favorable opinions about the 
enrichment program, stressing primarily the strength of the IDS 
materials and personnel. Moreover, the school administrators 
called for greater involvement of the IDS program with the rest 
of the school. As will be discussed later, the Institute has 
responded partly by initiating training sessions and workshops 
for principals and other non- Institute personnel. 

The Institute ■'s own supervisors were asked to write summaries 
of their impressions of the IDS program, outlining the major 
successes and failures they saw in it, as well as making sugges- 
tions for future change. The majority of the supervisors wrote 
what appeared to be balanced summaries. A major success which 
they emphasized was the individualization of Instruction in the 
IDS classroom. Among the weaknesses referred to, the most fre- 
quent was characterized as the failure of the in-service train- 
ing program to meet its stated goals. (See Procedure Section of 
this report) . 

In the 1967-1968 school year, group interviews were held by 
the research staff with teachers, assistant teachers, substitute 
teachers, and all other teaching personnel who were Involved 
with the IDS classroom program. Again, an apparently balanced 
response was obtained. Teachers stressed the success of the IDS 
program in terms of changing children’s behavior (e.g., the 
children seemed better able to work in an independent fashion) , 
while they responded negatively to the fact that the materials 
had changed from year to year (such as when the Sullivan reading 
materials were introduced) especially since they felt that the 
guidelines provided for the Implementation of new materials 
were Inadequate. 

Of all the groups whose qualitative reactions are reported 
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here, parents and older siblings have given the most positive 
response. Older children have proudly brou^t their friends to 
observe their younger siblings working in the IDS classroom 
(viewing the classroom from behind a two-way mirror) . Parents 
have repeatedly sent positive letters to the Institute about the 
program and about their children’s performance in it. Informa- 
tion from parents was also obtained from interviews and informal 
conversations with the Community Aides. In general, those 
parents vjhose children entered the program at prekindergarten 
noted changes in the child’s level of socialization, in his abil- 
ity to recognize and label things around him (e.g. , pictures of 
animals, signs, etc.), and in his ability to use language. Par- 
ents have noticed such differences in their children as changes 
in their basic attitudes toward school. In comparing their 
older children’s school careers to these of the enrichment group, 
parents noted a difference in the rate and quality of learning 
that takes place in the IDS classroom. Following are quotations 
from just a very few of the letters from parents to the Insti- 
tute . 

’’The Institute helps the children get a better understanding 
of why school is really important,” 

"They learn more things and faster.’' 

"It were as though he learned very fast and it Is very good.” 

Letters from parents have also included reference to their 
own involvemnet with the IDS program and the activities at the 
Parent Center. They noted that they had received help in such 
matters as housing, clothing, etc. Parents reported that the 
activities of the Parent Center seemed to help them feel more con- 
fident in talking with their children and being involved with 
their school experiences. 

"Because of the lesson plans at the Center and the instruc- 
tions given by the Institute , I am able to converse with my 
children.” 

"Before this I was very much embarrassed when my children 
would ask me questions and I could not answer them. After* en- 
tering the Center’s program, I can now talk with them and don’t 
feel embarrassed. I now have confidence in myself and feel 
secure.’' 

Reports from teachers who have received IDS children into 
their classes consistently emphasize the fact that the Institute 
children are easily Identifiable: not only by their overall 

"verbosity," but by their command of the language. These 
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teachers report that IDS children are genuinely interested and 
excited cibout learning, that they are more independent than 
other children and do not shy away from new situations. 

Visitors to the Institute classrooms have consistently re- 
marked on the independence shown by IDS children. In fact, 
this aspect of children's behavior has been an area o± axtensive 
research directed toward the assessment of classroom behavioral 
correlates of independence (Schumer and Deutsch , 1969) . 

It should be noted that the funding of the IDS enrichment 
prog;ram never covered any extensive qualitative evaluation, Tiie 
above summary is only included in this report because the authors 
believe that it provides valuable supplementary infor-riation to 
the results obtained from standardized tei'-cs. 
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CONCLUSIONS AND RECOMMENDATIONS 



GENERAL EVALUATION DISCUSSION 

The following smrirnary table is presented in order to fa- 
cilitate the discussion of results from what was a wide variety 
of measures, taken for four waves of children. 

Summary of Results Table 

Experimental children scored significantly higher than their 



controls on the measures listed 
follows : 

Test 

Stanf ord-Binet 



Peabody Picture Vocabulary Test 



Lorge-Thorndike 
Reading Prognosis Test 



Metropolitan Achievement Tests 
Reading Subtest-Word Knowledge 



MetroDolitan Achievement Tests 
Reading .Sulotest-Reading 



Metropolitan Achievement Tests 
Arithmetic Subtest-Problem 
Solving and Concepts 



at the tirrr.es specified, as 



Testing Period 

post-prekindergarten 
post kindergarten 
post third grade 



post-prekinder^ arten 
post kindergarten 
post third grade 

1st grade 
2nd grade 

end of kindergarten (only 
period given) 

2nd grade (greater than the C^l 
group only) 

3rd grade (greater than the C^ 
group only) 

2nd grade (greater than the C^ 
group only) 

3rd grade 



3rd grade (greater than the C]_ 
group onlS^) 



Early Childhood Inventories 
Body Parts Naming Inventory 

Relational Concepts Inventory/ All given at the 

Pre-Ma thema tins end of kinder garteir 

Relational Concepts Inventory/ 

Pre-Science 

Set Hatching Inventory 
Shape Name Inventory 



Illinois Test ci Psycholinguistic Abilities 
1961 Edition CComplete test) 

Visual Decoding" (calls for the ability 
to match objects that are conceptually 
similar) 

Auditory Vocal Association (calls f'or 
the ability to deal with analogiiss) 
Visual Motor Aasociation (calls fem 
the abilit\ ro associate objects 
that are functionally related) 

Auditory Vocal Automatic (calls for 
ability to handle grammatical 
forms) 

Motor Encoding (calls for the ability 
to express oneself in gestures) 

Vocal Encoding (calls for the ability 
to express oneself in words) 



at 1st, 2nd and ' ■ d 
grades 

repeated adminis- 
trations, longitui— 
inal samples 



Illinois Test of Psycholinguistic Abilities 
1968 Revised Edition (Six subtests) 

Visual Reception (calls for ability 
to match conceptually similar 
objects) 

Auditory Association (calls for ability 
to handle analogies) 

Sound Blending (calls for ability to 
produce a word x*jhen supplied with 
phonemic elements) 

These findings show positive change for children who have 
experienced five years of enrichment in the Institute for 
Developmental Studies^ program, as compared with control groups 
of children who were not in the enrichment program. Experimental 
children performed better on a number of measures of ability and 
achievement, and appeared to maintain much of their early en- 
richment advantage over their controls. 



1st, 2nd and 3rd 
grades, cross- 
sectional samples 



Although the actual achievement levels of the Css-Ck child- 
ren seem somewhat atypic^lly high for this population (higher 
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than those attBined hy the population of children in the IDS 
cooperating sc:r . >ls) , their scores follow a t a tte-rn. that is 
typically founc in schools in low income areas. 

On measures of intelligence and achievement, rhe control 
children score far below the national norms for ti,eir ag® and 
grade groups. At the end of kindergarten, Stanf' rd— Binet mean 
IQs for Css, Ck and Ci groups were 93.00; 92.50 and 84.02, 
respectively; in contrast, experimental children reached the* 

100 level on the Stanf ord-B inet test ait the end ^ f kindergartei 
and maintained most of their gains over a period of time. 

Some cumulative deficit effect is apparent for almost all 
of the treatment waves C^onfirming the results of previous re- 
search — see Whiteman and Deutsch, 1967) from the and of kinder- 
garten to the end of the third grade. Nevertheless, at the eind 
of the third grade the E group mean was still reasonably clos-e 
to the national norm for this test (96. /I) , while the means ~or- 
the control group children fell far below the national norm^ 
Apparently the program was able to raise the children’s S— B lO 
scores substantially by the time they entered first grade, hut 
no further gains (and some regression) were evident after first 
grade. Although early enrichment was reinforced by the contin- 
uation of the special program in the first three grades, the 
inputs to the latter were less systematic and developed than 
those to the former; reinforcement in the grades was not suffi- 
cient to enhance the early gains made in preschool. It must be 
noted, however, that the control groups showed a decline from the 
first to the third grades, and maintenance of gains on the part 
of the E group must be seen in this context. 



1. The pattern of achievement scores for the control children 
would lead one to conclude that they were a representative group 
and, in some respects, were appropriate to use for comparison, 
purposes. The actual achievement levels , on the other hand, 
would lead one to conclude that these children were an atypical 
group, and should not be used for strict comparisons. A numfc.er 
of factors may have influenced the control children’s scores, 
factors which were characteristic of Css and Ck r.hildren but 
not of their peers who attended the same schools. For example, 
children in the Css and Ck group came fz’om families that have 
lived in the same area for a period of five years. This geogra- 
pl;ic stability is not typically found with disadvantaged popula- 
tions. Also it is possible that these control children became* 
more test-wise than their schoolmates, and their test results may 
have been inflated because of this. 
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The ss'ine pattern can be seen in the results of the Peabody 
Picture rah ilar}/ Test. Here, again, the differences between 
exper t-Viar: -iiL and aontrol children were greater at the end of 
prekindar iter ten than they were at the end of third grade, 
though the troups differed significantly at all testing periods- 
These reauhes corroborate our earlier interpretation that the 
effects of the IDS preschool program were very strong and posi- 
tive; those of the less developed grades program, while evident, 
were less strong and, as will be expanded upon later, less obvi- 
ous. Parenthetically, one should note that the amount of im- 
provement (or defdait) was greater (or lesser) with each suc- 
ceeding we 'e of children. The grades program appears to have 
increase'! in its effectiveness v?ith time, and with the devel- 
opment of and input into this portion of the total five year 
enrichment curriculum. 

The Pl’VT results themselves pose special and difficult prob- 
lems for Interpretation. For this population, one cannot eval- 
uate the scores in and of themselves, but should interpret them 
in terms cf change and comparisons (see the discussion of the 
unrepresen _ative nature of the standardization sample for this 
test on page 39 Procedure Section). Also, there seems to be 
some evidence that, given the present type of population, PPVT 
IQ scores will increase with age, and with exposure to a normal 
school program; however, it is impossible to accesss the con- 
tribution of these factors beyond the prekindergarten year for 
this study. As can be seen, the Css group showed a 7 point 
change during the first year, without any systematic educational 
intervention (the E group gained 14 points during the same time 
interval) ; the Css group gained 8 points following exposure to 
the regular public school kindergarten program. We cannot 
assume that equivalent changes occurred in later grades; nor can 
we assume that the changes are reliable measures of the develop- 
mental trend. 

Up to this point, our discussion has focussed on longitudinal 
intelligence measures, and has emphasized the fact that the pro- 
gram was quite successful in prekindergarten and kindergarten, and 
somewhat less successful in the grades. Although the grades cur- 
riculum appeared to have been less effective than the preschool 
program, the early enrichment advantage (i*®* higher means) for 
the E group was not lost by the end of 3rd grade. While this 
initial enrichment advantage was obviously a positive finding, it 
may in itself have contributed to the less impressive later re- 
sults. The higher means of the E group, attained after kinder- 
garten, may have made it more difficult for them to continue to 
gain as fast in the grades as they had 5.n prekindergarten and 
kindergarten: gains from a high baseline are typically more 

difficult to achieve than those from a lower baseline. 



T; - nly notable exception to this pattern is the result 
of rhi .-.’61 version of the Illinois Test of Psycholinguistic 
AbiLir-^, (As the 1968 version was administered cross-sec- 
ticr.s3 . results from this test are not applicable to the pre- 
sent c:i 3C--i3sion.) As can be seen in Figures 2, 3, and M, total 
test rvfr-fsrences between E and Css groups increased with grade, 
showi-tra 7 positive effect of enrichment in the grades. 

I" .Tri-Iation to achievement in the grades, the results of 
the M--. .jolitan Reading subtest do not lend themselves to any 
clear i:._ ~ement. In addition, our own results shed doubt on 
the VS-' ' .Ity of these tests for our population and for the 
readi- _ .rrogram followed in the Institute classes. 

In erms of actual achievement levels, experimental children 
met, cn closely approximated, grade level standards. By the end 
of 3rd grade the E group was less than two months behind grade 
level In vocabulary skills, and less than three months behind 
grade level in comprehension skills. Moreover, the third wave 
(the latest included in this anlysis) scored above grade level 
on botn 'hrd Knowledge and Reading. 

However, the comparison of second and third grade data is 
very confusing. While the mean advantage of tne experimentals 
over controls (on both Word Knowledge and Reading -subt^sfs) in- 
creased from 2nd to 3rd gr*ade, the grade equivalent scores for 
the E grrmup fall farther below grade level when comparing se- 
cond ane third grade scores for these subtests. 

It ssems appropriate at this point to mention that the use 
of grade equivalent scores may have reduced the likelihood of 
obtairring significant differences between the groups. A two- 
month g- ade equivalent difference can be the same as a six- 
point standard score difference. The manual for the Metropolitan 
recommends the use of standard scores for statistical purposes. 
However a as was mentioned in the Procedure Section, the school’s 
decision to administer two different forms of this necessitated 
the use of grade equivalents rather than standard scores. More- 
over, there is some evidence that indicates that the MAT Reading 
subtest may not be an adequate measure of reading ability in this 
type of population. The correlation between the Ga tes-MacGinitie 
Comprehension subtest and the Metropolitan Reading subtest was 
only .57 for 19 third grade E children and .25 for 28 third grade 
C children. Although the n’s are small there is a strong possi- 
bility that had another instrument been chosen to measure reading 
the resc.lts would have been quite different. 

While there is some doubt about the validity of the Metro- 
politan iP eading Subtest for this population there is even greater 




question conoerning the relevancy of the Metropolitan Arithme- 
tic Subtest. As was indicated in the Procedure Section, the 
Metropolitan Arithmetic Subtest does not tap many of the elements 
thac comprise the IDS curriculum (e.g., sets). 

As noted, there were many problems and limitations in 
attempts to adequately assess the children by means of the pub- 
lished standardized tests. The Early Childhood Inventories (ECI) 
did, however, provide information that seems to relate more 
specifically to the IDS curriculum elements, and to tap many of 
the skills generally considered to be important for young child- 
ren to have- 

VJhile groups generally were not pretested in the ECI prior to 
educational intervention, pretest equality of groups was inferred 
from pretest equality on other intelligence measures (notably the 
Stanf ord-Binet and Peabody Picture Vocabulary Test.) 

Of the five subtests on which significant differences (be- 
tween E and Ck groups) were found, three of them measure con- 
ceptual skills: two relational concepts subtests (Relational 
Concepts Inventory/Pre-Mathematics and Relational Concepts 
Inventory/Pre-Science) and the categorization subtest (Set Match- 
ing Inventory) . Results on the labelling tasks were less im- 
pressiv'e. Although the scores indicated that the E group knew 
Body Parts and Shapes better than the Ck group, differences on 
other naming tasks (Alphabet letters and Numerals) did not reach 
significance. In addition, on a task requiring the child to 
abstract out concepts of quantity despite changes in figural 
characteristics between standard anfl comparison pictures (the 
Quantity Matching Inventory) , scores did not significantly 
differentiate the groups. 

It should be noted that, although the skills measured by 
these inventories are skills taught in the IDS program, they are 
also generally taught in most cognitively oriented preschool 
programs. Furthermore, it should be noted that the IDS teachers 
were not aware of the content or nature of the Inventories; the 
content was not designed to resemble closely the IDS' curriculum 
materials (insuring that the effects were not simply due to 
practice and familiarity with specific materials) . 

The design of this experiment does not permit one to draw any 
conclusions about the specific elements of the interviewing var- 
iable (the curriculum) that were responsible for the specific 
behaviors demonstrated on the various ability and achievement 
measures given. However, judging both from the qualitative and 
quantitative evaluations presented, one can speculate as to the 
general nature of the change in behavior observed in the children. 
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First, as can be seen in the curriculum abstract, the 
IDS program is primarily cognitive and language oriented; the 
approaches presented emphasize the development of children’s 
thought processes, as well as the facilitation of communication 
and general language skills. 

The relatively high performance of the E children on the 
Stanf ord-Binet , Lorge-Thorndike , and the Peabody Picture Vocab- 
ulary Test, as well as the grade equivalent scores on Metropol- 
itan Word Knowledge, Reading, and Problem Solving and Concepts 
portions underscore the effectiveness of those elements of the 
curriculum that are both cognitively and linguistically based. 

In contrast, one can see that on those measures where rote 
memory or mechanical operations are extremely important, (where 
the ability to solve problems is not tapped) , the children do 
not score signif icantLy higher than their controls. This is 
most evident from the pattern of scores on the Computation 
portion of the Metropolitan Arithmetic ^ubtest 

At this point the limitations of testing procedures, in- 
cluding the ones utilized here, should be stressed. When the 
IDS evaluation design was first planned, we were faced with a 
situation in which there existed a paucity, of instruments that 
could assess tne mental development of preschool children. 
Moreover, since longitudinal evaluation was most desirable, the 
Institute sought to use those instruments that could be appli- 
cable to the broad spectrum of ages that would eventually be 
included in the sample. For those reasons, the Stanf ord-Binet 
(S-B) and Peabody Picture Vocabulary Test (PPVT) were chosen as 
the first major evaluation instruments.^ 

While the Stanf ord-Binet seems to be a fairly reliable 
instrument with low SES urban populations, its validity is ques- 
tionable in terms of the cultural bias inherent in a test devel- 
oped for, and largely standardized on a white, middle class sam- 
ple. One of the few extensive investigations that attempts to 
establish norms for lower class Black children is that of Kennedy 
et. al. , (19 ^'3 ) , whose sample only included Southern children. 

Similarly, a search of the available literature did not reveal 
any study that clearly established predictive validity for a 
population such as one from which the IDS sample was drawn. 



2. The Columbia Mental Maturities Scale was also chosen as a 
test of conceptual ability. It became apparent, however, that 
the test was rather unreliable with our population and had 
questionable validity (see Buros, 1965). The CMMS is currently 
undergoing revision. 



For the Stanf ord-Bine t one should also consider many aspects 
of the testing situation, with the possibility of situational 
and experimenter variables being operative.^ Another problem 
regarding the use of the S— B is its global nature. The instru- 
ment cannot be regarded as a true test of the effectiveness of 
the IDS program because its relationship to the specific curric- 
ulum input is not clear. Also, since the sub test scores were 
not available from the S-B , it cannot be used to separate out 
dif f ex'ential effects of the various curriculum elements. 

The Peabody Picture Vocabulary Test may reflect an even 
greater degree of cultural bias as its standardization sample was 
disproportionately weigiited with children from the white middle 
class Nashville area. This bias is especially apparent when 
children are tested at very early ages; both the black, lower 
class children from our Northern sample, and those in Klaus and 
Gray’s (1968) Southern sample show initial IQs in the low 60’ s. 

Other standardized instruments, which, were used in our 
evaluation, were the Illinois Test of Psyoholinguistic Abilities 
(ITPA) and the Metropolitan Achievement Tests. The ITPA has 
recently been revised and its reliability and validity still have 
not been clearly established. There are some investigators (such 
as Weikart — cited in Smith and Bissell, 1970) who question its 
reliability with lower class samples. The cognitive-linguistic 
nature of the ITPA makes it the kind of instrument that would 
appear to be most app.licable to the IDS program. However, again, 
the relationship between the ITPA subtests and the IDS curriculum 
input is not althgether clear; its usefulness as a measure of 
the effectiveness of specific curriculum elements remains open 
to question. 

A further limitation of our testing procedures should be 
noted in regard to the Metropolitan Achievement Tests. The 
Metropolitan Reading- Subtest, for exaitpie,taps only vocabulary and 
comprehension; it cannot be regarded as an ideal measure of the 
IDS reading program which places heavy emohasis on phonics. In 
addition, the Metropolitan Reading .Subtest does no tap such skills 
as the ability to combine elements and sound out new words. 

This particular skill is one element of a phonics-based reading 
program that was considered to be important as a learning tool, 
one which a child could use in approaching new material and 
developing more advanced reading skills. 

The Metropolitan Arithmetic Subtrest has similar limitations in 



3. For a more detailed discussion of this issue see Deutsch, 
et. al. , 196M . 
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terms of this evaluation. The suhtest contains a Computations 
portion, as well as a Problem Solving and Concepts ''portion. 

The former portion covers a skill not considered by the IDS 
curriculum staff to be as important a mathematical skill as 
some others; hencc: IL is not stressed in the IDS curriculum. 

Instead, more time is spent in the IDS classroom on conceptual 
areas (such as set theory) that are not tapped by the Metro- 
politan Arithmetic Suhtest (See pages 21 through 23.) 

A second problem in considering the Metropolitan scores is 
that these test^ is administered by school personnel and not 
by the Institute’s testing staff. The results of these 
are a matter of public record and- especially those from tne 
Reading sub test carry a great dear cf weight in determining the 
progress of a particular school. Since the primary responsi- 
bility of Institute teachers is to implement the Institute’s 
program (and report to the Institute’s own supervisory staff 
rather than through regular Board of Education channels) , the 
IDS teacher is minimally concerned with the school’s standing in 
relationship to dther schools. In interviews and discussions 
with staff in various schools, it would appear that considerable 
stress is placed on preparing children for taking these tests 
in non-IDS classes. 

As was mentioned in several places above, many factors 
intervened in the operation of this program that modify the 
extent to which the rigid parameters of a strict experimental 
paradigm (of experimental vs. control) can be used in inter- 
preting these data. One of these factors, the diffusion of 
experimental curriculum elements to non-experimental groups, will 
be discussed here- to exemplify the kind of non-quant if ied and un- 
controlled variables that commonly occur in field experiments, 
and that may have influenced the overall picture of the results 
presented here. 

Diffusion will be discussed here only in terms of its op- 
eration within the host schools and of the consequent ’’contamina- 
tion” of control groups, whose members were exposed to an unde- 
termined number of elements of the experimental treatment in the 
non-experimental classrooms. Diffusion has been discussed by 
ethers (e.g. , Klaus and Gray’, 1968) in another vein: vertical diffusion 
from the one child in an enrichment program to the other children 
ir. the family. This problem has not, as yet, been fully explored 
by IDS. However, a preliminary investigation revealed a tendency 
for the younger siblings of children in the IDS program to score 
higher on pretest (prekindergarten) measures than their older 
brothers and sisters. 

The diffusion of curriculum elements to non-experimental 




classes has occurred both as a result of planned actlvltle 
and of less Intentional circumstances. For example, at^ 
various times the Institute’s staff has conducted training 
sessions for the teachers of regular classes at certain grade 
levels within the cooperating schools. Also, the principals 
of several of the host schools have attended IDS worKshops, 
presumably transferring some of the ideas and methods pre- 
sented there to their own schools. While these activities, and 
others like them, may have resulted in diffusion, they were 
considered to be Important and desirable by the Institute s 
staff, whose primary commitment was to the communities in whic 
the program operated, rather than to the strictness of an ex- 
perimental design. 

In addition to these planned activities^ o'-her less inten- 
tional events have resulted in this type of diffusion. Although 
IDS teachers made an effort at first to keep their curriculum a 
"secret” from other members of the regular school staff, this 
practice was not followed in the later years. The extent and 
quality of informal communication that occurred among the teach- 
ers cannot be readily determined. To give just one further ex- 
ample, it is apparent that this diffusion of the IDS program 
occurred when a former IDS teacher became a supervisor of regu- 
lar classes in one of the cooperating schools. 

In addition, there were many problems associated with the 
fact that the Institute’s program operated in regular New York 
City public schools. The physical plants of many of the cooper- 
ating schools were in dilapidated condition, were _ inadequate to 
meet the schools’ needs, and were depressing settings in which 
to learn. Also, the support staff in these schools was limited, 
making it difficult to provide time for grade teachers, who 
worked a full school day, to participate in extensive in-service 
training activities. 

It is obvious that the experimental program itself was only 
one of a nurrODer of possible input variables which may have been 
operative, and which may have influenced the children s perform- 
ance. No attempt has been made in this evaluation to systema- 
tically tease out the relevant extra-educational variables, and 
to account for their influence on the children’s performance. 
(Tor reports on some of these other variables, see Deutsch, ^ 
et al , 1967:) Indeed, it has been extremely difficult to iso- 
late those specific educational Inputs that were responsible tor 
the experimental children’s gains or, moreover, to tap those 
educational Inputs that were not measured by the available 
standardized instruments. In the last analysis, one must ice.-y 
on both quantitative and qualitative information, and one must 
view these results in light of all the forces working again ^ 
the program's success , in order to obtain a fair evaluatxon o 
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its effectiveness. 



Educational Significance of the Program 



The evidence we have just reviewed provides support for the 
conclusion that, particularly in the preschool years, the IDS 
experience was successful for the children enrolled in it. We 
have demonstrated that, under conditions of sustained enrichment 
and adequate stimulation, children from depressed areas can and 
do learn. 

The effects on the IDS experimental children themselves is, 
however, but one measure of the program’s influence on education 
in general, for children throughout the United States. The 
IDS program was a pioneer in the current U. S. preschool movement. 
Its emphasis on cognitive development in the early years has 
been adopted by many of’ the more successful early childhood 
programs including several of the more effective Head Start and 
day care programs. 

In addition many elements and ideas from the IDS program 
have been incorporated into programs in other communities through- 
out the nation, such as the Far West Regional Laboratory, Follow 
Throu^ Model, the Interdependent Learning Follow Through Model 
and the IDS Planrxed Variation Model. Portions of our program and 
approach have been disseminated into communities in nearlv every 
state of the union, the Virgin Islands and Jamaica, the British 
West Indies, etc. 



Preparing guidelines for future work in this area, based on 
the decade of experience in research, in training, and in the 
classroom itself, is no simple task. 

Many of the things that were learned as the enrichment pro- 
gram progressed were incorporated into it to help make it operate 
more effectively. Indeed, although we have outlined some general 
approaches and techniques, no single description of this curric- 
ulum could ever adequately reflect its nature, for it was de- 
signed to be continuously evolving, and at no point in time 
represented a monolithic entity, with each teacher mediating the 
purposes and approaches of the program in her own classes. 

One of the most important recommendations that can be made 
for evaluation efforts is related to the development and utili- 
zation of more relevant measures, those that have been properl^^ 
standardized and validated for use with this population. One 
should attempt to develop and use measures which have the intrin- 
sic capacity to measure the child’s responsiveness, and also to 
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measure the ability of the system l. > respond to the child. 

However, tlie px’oljlems of '-v!.p,nJ.j:y a id evaluating the 
effects of an enrichment prograiii • f ir beyraid developing more 
valid measures 5 or devising expe^ imc iJ f signs which take into 
consideration all the extra-school and uncontrolled variables 
which have influenced the children’s behavi '>r and development. 

Enrichment programs operate within an entire social context, 
and often within a framework with many conflicting socio-politi- 
cal forces which ii'estrict program effectiveness and make it 
difficult to extrapolate from these experiences to the future. 
Such extrapolation is obviously desirable for enrichment pro- 
grams and for the parents, teachers, and children involved. 

There is characteristically general social pressure for imme- 
diate gains on such measures as achievement or intelligence 
test performance, and for the evaluation of the success of a 
program on a ratio scale where one divides numbers of 10 points 
raised by dollars to get an index of success . 

In the long run, only the children are short-changed by 
rhis state of affairs. Directors of enrichment programs are 
continually pressured into affirming that each element of their 
program reflects the most effective method. Frequen children 

must settle for a program’s first efforts, simply because the 
program is penalized for any "mistakes''’ by threats of cessation 
of continuing financi.al support. 

Long term commitments are necessary so there can be an 
interplay of innovation, training, evaluative feedback, and 
parental as well as community participation. It is necessary 
for participation and resources to come from all levels of the 
schools and universities, as well as from the children and their 
communities. In addition, old experimental-control models are 
simply not adequate. A special program should allow its influ- 
ence to evolve and be conscientiously diffused in the entire 
school setting, incorporating conscious feedback mechanisms. 

As previously pointed out, considerable diffusion takes place 
anyhow; boundaries become artificial and reflect statistical 
artifacts, not social realities. 

There is also an ethical issue involved in relegating a 
group of children as no recipients of long term treatment that 
one is now reasonably sure will be beneficial to the children 
who are receiving the appropriate inputs. 
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APPENDIX I -SUPPLEMENTARY TABLES 

Table A 

Analysis of Vai^iance of Attrition Effect 
on Stanford-Binet IQ bccres 
for E and Css Groups (3 Waves) 



Source df MS F 

Total 

Between 



Subject Group 


(A) 


1 


12.52 


^ 1 


Drop-Out Time 


(B) 


5 


221. DM 


1.99 


AB 




5 


129.56 


<1 


Within 




268 


153.39 
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Table B 

Analysis of Variance of Attrition Effect 
on Stanf ord-Binet IQ Scores 
for' Ck Group C3 Waves) 



Source 


df 


IiS 


X* 

JL 


Total 


123 






Drop-Out Time 




202.42 


1.58 


Within 


119 


127.80 
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Table C 

Analysis of Variance of Attrition Effect 
on Stanford-Binet IQ Scores 
for C 2 ^ Group (3 Waves) 



Source df 
Total 151 
Drop-Out Time 3 
Within ms 



MS 



F 



383.40 2.31 

156.23 








Table D 

Analysis of Variance of Attrition Effect 
on Peabody Picture Vocabulary Test Scores 
for E and Css Groups (3 Waves) 



Source d"^ 

Total 

Between 

Subject Group (A) 1 

Drop-Out Time (B) 5 

AB 5 

Within 269 



MS F 

42.03 1 

585.06 2.21 

422.88 1.60 

264.58 



O 
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Table E 

Analysis of Variance of Attrition Effect 
on Peabody Picture Vocabulary Test 
Scores for Ck Group (3 Waves) 



Source 


df 


MS 


F 


Total 


163 






Drop-Out Time 




73,86 


1 


Within 


159 


362,29 
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Table F 

Analysis of Variance of Attrition Effect 
on Peabody Picture Vocabulary Test 
Scores for C-j^ Group C3 Waves} 



Source df 
Total 150 
Drop-Out Time 3 
Within 1M7 



MS F 

M22.71 1.16 

363.34 




11 6 
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Tabls G 

Analysis of Variance of 
Stanford— Bine t IQ Scores 
at Pre-Prelcindergarten for M Waves of 
E and Css Subjects 



Source 


df 


MS 


F 


Total 


403 


155.76 




Between 


7 


215.05 




Wave CA) 


3 


463.24 


2 


Subject Group CB} 


1 


78.43 


<1 


AB 


3 


12.40 


<1 


Within 


396 


154.71 





* p < . 05 







f 






117 



99* 
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Table H 

Analysis of Variance of 
S tanf ord-B inet IQ Scores 
at Post PreRindergarten fox* 4 Waves of 
E and Css Subjects 



Source 


df 


MS 


F 


Total 


401 


146.57 




Between 


7 


685.77 




Wave (A) 


3 


70.03 


. 51 


Subject Group CP} 


1 


4358. 76 


31.82 * 


AB 


5 


77,17 


- 56 


Within 


394 


136.99 





* p < . 0001 
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Table I 

Anaiysis of Variance of 
Stranf or*d-B inet IQ Scores 
at Post Prekindergarten 
(E , Css, Ck Groups, 3 Waves) 



Source 


df 


MS 


F 


Total 


979 


19 8 „ 86 




Between 


8 


822.69 




Wa ve C^) 


2 


295.37 


2 . 15 


Subject Group CB) 


2 


2820. 01 


20.52* 


AB 


4 


87.60 


<1 


Within 


971 


137.91 





* p-^.OOOl 
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Table J 

Analysis of Variance of 
Stanford— Bine t IQ Scores 
at Post Kindergarten 



Source 


df 


MS 


F 


Total 


6M6 


203„ M2 




Between 


15 


1332.39 




Wave CA) 


3 


356 . 31 


2 . 02 


Subject Group 


3 


5566 . OM 


31.52* 


AB 


9 


2M6 . 53 


1. MO 


Within 


631 


176.58 





* P - 0001 
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Table K 

AnaXysis of Variance of 
Staiif ord~B ine t IQ Soor'es 
af Grade 3 



Source 


d.f 


MS 


Total 


243 


X79 . 004 


Between 


XX 


30X.9X 


Wave (A) 


2 


892.59 


Subject Group 


CB) 3 


399.78 


AB 


6 


56.09 


W-i th in 


232 


X73.X8 



P < . OX 




121 



p 



5.X5* 
2.31 
< 1 
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Table L 

Analysis of Variance of 
Peabody Picture Vocabulary Test 
At Pre-Prekindergarten 



Source 


df 


MS 


F 


Total 


399 


230 S8 




Between 


7 


520.70 




Wave fA) 


3 


939. 20 


4 . 17* 


Subject Group 


(B) 1 


647.72 


2. 87 


AB 


3 


59.87 


<1 


Within 


392 


225.40 





* p < . 01 
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Table M 

Analysis of Vaariance of Peabody 
Pictrur-e Vocabulary Test 
at Post Prekindergax’ten 



Source 


df 


MS 


F 


Total 


631 


366.13 




Be tv7een 


11 


1315.47 




Wave 


'5 


711.10 


2 . 04 


Subject Group 


CB) 2 


5179.77 


14 . 83* 


AB 


6 


329.56 


<1 


Within 


620 


349.28 





* p ^ . 0001 




123 






Table N 

Analysis of Variance of Peabody 
Picfu.r’e Vocabulary Test 
at Post Kindergarten 



Source 


df 


MS 


F 


Tore! 


659 


337.34 




Bet\>7een 


15 


1M6S , 89 




Wei ve (A) 


3 


1115.02 


3-59 


dubjecir Group 


(B) 3 


5078.88 


16 .33** 


AB 


9 


383 . 52 


1-23 


Within 


64J4 


310.99 





* p . OS ** p<;.0001 
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Table O 

Analysis of Variance of 
Peabody Picture Vocabular^^ Test 
Post Grade 3 



Source 


df 


MS 


F 


Total 


^47 


221.79 




Between 


11 


311. 95 




Wa VC (A} 


2 


380. 74 


1.75 


Subjject Grovip CB) 


3 


730.60 


3. 36* 


AB 


6 


79.70 


<1 


Witbin 


236 


217.59 





* p < , 05 
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Table P 

Analysis of Variance of Lor ge— Thorndike 
IQ Scores at Grade 1 



Source 


d±' 


MS 


F 


Totral 


501 


113. 29 




Between 


15 


325.10 




Wave (A) 


'j 


M6M.95 


M . 36* 


Subject: Group 


LO 


882,17 


8 . 26* 


AB 


9 


92.79 


<1 


Within 


MSG 


106.75 





* p<.01 ** p<.0001 




126 
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Table Q 

Analysis of Variance of forge -Thoi?ndxl<e 
IQ Scores at Grade 2 



Souicce 


df 


MS 


F 


Total 


379 


196-50 




Between 


15 


286.90 




Wave i^A') 


3 


3 - 23 


<1 


Subject Gi?oup 


(B) 3 


635. 06 


4 . 51* 


AB 


9 


26M - 56 


1.88 


With In 


36M 


140.73 





* p < . 01 
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Table R 

Analysis of Variance of Reading Prognosis Test Raw Scores 
for Waves of E, Css, and Ck Subjects 
by Wave and Subject Group 



Source df 

Subject Group (A) 2 

Wave (B) 3 

AB 6 

Within 451 



MS F 

1377.35 14.38* 

274.25 2.86** 

412.94 4,31 

95.79 



* p.^ .01 ** p <; .05 
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Table S 

Analysis of Simple Effects of Reading Prognosis Test Raw 
Scores for Waves of E, Css, and Ck Subjects 
by Wave and Subject Group 



Source 






df 


MS 


F 


B for Ai 


(E) 




3 


660. 40 


6. 89* 


A2, 


(Css) 




3 


302.95 


3.16* 


^3 


(Ck) 




3 


136.90 


1.43 


Within 






451 


95.79 




A for 


(Wave 


1) 


2 


2078. 26 


21. 70* 


B2 


(Wave 


2) 


2 


267. 33 


2.79 




(Wave 


3) 


2 


204.18 


2. 13 


Bg 


(Wa ve 


M) 


2 


116. 58 


1. 22 


Within 






451 


95.79 




* p 01 


** 


p 05 
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Table T 



Analysis of Variance of Metropolitan 
Achievement Test, Word-Knowledge Subtest 

et Grade 2 



Source 


df 


MS 


F 


Total 


3Q1 


55.50 




Between 


11 


82.68 




Wa ve (A) 


2 


38.25 


<1 


Subject Group 


(B) 3 


159.21 


2.92* 


AB 


o 


59.23 


1.09 


Within 


29Q 


5M.LS7 





•* p<.05 




130 
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Table U 

Analysis of Variance of Metropolitan 
Reading Test, Word-Knowledge Sub test 
at Grade 3 



Source 


df 


MS 


F 


Total 


242 


100.40 




Between 


11 


168.69 




Wa ve (A) 


2 


397.39 


4.09 


Subject Group 


CB) 3 


173.79 


1.79 


AB 


6 


89.92 


<1 


Within 


231 


97-15 





* p < . 05 
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Table V 

Analysis of Variance of Metropolitan 
Reading Test, Reading Subtest 
at Grade 2 



Source 


df 


MS 


F 


Total 


301 


67.35 




Between 


11 


81.96 




Wa ve C-^) 


2 


132.18 


1.98 


Subject Group 


CB) 3 


191.99 


2. 12 


AB 


6 


35.29 


<1 


Within 


290 


66.80 






132 
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Table W 

Analysis of Variance of Metropolitan 
Reading Test, Reading Subtest 
at Grade 3 



Source 


df 


MS 


F 


XOtc- L 


242 


87.13 




Between 


11 


114 -OM 




Wa ve (A) 


2 


226.45 


2-64 


Subjlect Group 


CB) 3 


141-76 


1.65 


AB 


6 


62.70 


<1 


Within 


231 


85.85 






till 
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Table X 

Analysis of Variance of Metropolitan 
Arithmetic Test, Problem-Solving Subtest 
at Grade 3 



Source 


df 


MS 


F 


Total 


220 


75.38 




Betv?een 


11 


118.31 




Wa ve (A) 


2 


368.30 


5.04* 


Subject Group 


(B) 3 


119.38 


1.63 


AB 


6 


34.45 


<1 


Within 


209 


73.12 





* p < - 01 
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Table Y 



Analysis of Variance of Metropolitan 
Arithmetic Test, Computations Subtest 

at Grade 3 



Source 


df 


MS 


F 


Total 


22Q 


62.35 




Between 


11 


99.10 




Wave (A) 


2 


178.27 


2.95 


Subject Group 


(B) 5 


111.28 


1 . 8M 


AB 


6 


66.62 


1.10 


Within 


209 


60. Ml 
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Table Z 



Summary Tr:ble fcr the Analysis of Variance of 
Total ITPA (1961 Version) Scores for 
Males and Females from Two Schools, Under Two Treatments, 

Over Three Years of Testing 



Source df 

Total 227 

Between 75 

Subject Group (A) 1 

School (B) 1 

Sex (B) 1 

AB 1 

AC 1 

BC 1 

ABC 1 

Subj w grp 68 

(El) 

Within 152 

Grade (D) 2 

Subj X D 150 

AD 2 

BD 2 

CD 2 

ABD 2 

ACD 2 

BCD 2 

ABCD 2 

Subj X D w 136 

grp (E2) 



* p < , 01 



MS F 



272766.79629 9. M3* 

20520.82225 <1 

8M39. 98762 <1 

11587.06879 <1 

3^96.97031 <1 

2667.5M975 <1 

MM181. 02175 1.53 

28925.72325 

1853.79109 <1 

7537.55633 2-76 

M82.7M563 <1 

1281.58202 <1 

333.7M3M5 <1 

67M.6551M <1 

3816.35376 <1.M0 

3716.88026 1.33 



2727.M3873 




136 
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Table AA 

Summary Table for "the Analysis of Variance of Scores of the 
Auditory Decoding Snbtest of the ITPA C1961 Version) , for 
Males and Females from Two Schools, Under Two Treatments, over 

Three Years of Testing 



Source 



df 



MS 



F 



Total 



227 



Between 



75 



Treatment (A) 1 

School (B) 1 

Sex (C) 1 

Ag 1 

AC 1 

BC 1 

ABC 1 

Subj w grps 68 

(El) 

V/lthln 152 



Year (D) 

Subj X D 

AD 

BD 

CD 

ABD 

ACD 

BCD 

ABCD 

Sub 3 X D W 



2 

150 

2 

2 

?. 

2 

2 

2 

2 

136 



37690.99590 1-86 

7283.07152 ^<1 

29801.96686 1.97 

3272.53709 <1 

2957.79819 <1 

6850-01879 <1 

66302.22080 3.27 

20290.30302 



32389.16105 9.77* 



21180.65626 3.12 

3173.89186 i 1 

11937.81151 1.69 

9510.80897 1.90 

5569-68689 *■ 1 

16315.82819 2.90 

15599.89938 2.28 

6787.66625 



*p < . C5 
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Table BB 

Summary Table lor the Analysis of Variance of Scores on the 
Visual Decoding Subtest of the ITPA (1961 Version) for Males 
and Females from Two Schools, under Two Treatments, over 

Three Years of Testing 



Source 


df 


MS 


F 


Total 


227 






Between 


75 






Treatment (A) 


1 


70592. 6M691 


7.31* 


School (B) 


1 


5031.99320 


< 1 


Sex (C) 


1 


13MM66.7520M 


12.70* 


AB 


1 


61576. 85M2M 


5.82** 


AC 


1 


175.71084 


<1 


BC 


1 


98.41643 


< 1 


ABC 


1 


16560.28764 


1.56 


Subj s grps (El) 


68 


10585.15350 




Within 


152 






Years (D) 




35808.27770 


6.84* 


Subj s D 


u 






AD 




3352.05164 


V 1 


BD 


2 


30969.62254 


5.92* 


CD 


2 


7259.65362 


1.41 


ABD 


2 


233.00563 


< 1 


ACD 


2 


754.42398 


< 1 


BCD 


2 


2016.31251 


< 1 


ABCD 


2 


3102.31163 


<1 


Subj X D w, grps 


136 


5234.47224 





"9 e 

CE2) 



* p >< . 01 ** p < . 05 




138 , 
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Table CC 

Summary Table for the Analysis of Variance of Scores on the 
Auditory- Vocal Association Subtest of the ITPA (1961 Version) 
for Males and Females from Two Schools, under Two Treatments, 

over Three Years of Testing 



Source 


df 


MS 


F 


Total 


227 






Between 


75 






Treatment (A) 


1 


1303M6. 57770 


5.72* 


School (B) 


1 


18383.26211 


<1 


Sex (C) 


1 


119.79357 


<1 


AB 


1 


989.31799 


<1 


AC 


1 


5119 .‘28791 


<1 


BC 


1 


1376.19751 


<1 


ABC 


1 


11550.93686 


<1 


Subj W grps (El) 


68 


22786.26891 




Within 


152 






Years (D) 


2 


3727.97795 


<1 


Subj X D 


150 






AD 


2 


6591.80956 


1.21 


BD 


2 


1660. 01898 


1 


CD 


2 


23219.06028 


9 . 25* 


ABD 


2 


737.86818 


^1 


ACD 


2 


1135,05928 


< 1 


BCD 


2 


9085.07702 


1.77 


ABCD 


2 


6658.90008 


1. 22 


Subj X D w grp 


136 


5957.70787 




(E2) 








* P >< .05 








O 








ERIC 


139 







-30- 



Table DD 

Summary Table for the Analysis of Variance of Scores on the 
Visual-Motor Association Subtest of the ITPA (1961 Version) 
for Males and Females from Two Schools, un der Two Treatments, 





over 


Three Years of Testing 


Source 


df 


MS 


F 


Total 


227 






Between 


75 






Treatment (A) 


1 


79517.36993 


6.44* 


School (B) 


1 


14533.84777 


1.23 


Sex (C) 


1 


4491.03441 


<1 


AB 


1 


21172.69723 


1.71 


AC 


1 


25530.67303 


2.07 


BC 


1 


16615.33758 


1.24 


ABC 


1 


4091.70551 


<1 


Subj w grp 


68 


12353.60361 




(El) 








Within 


152 






Year (D) 


2 


28804.25683 


4 . 89** 


Subj X D 


150 






AD 


2 


1881.46822 


<1 


BD 


2 


540.98429 


-^1 


CD 


2 


1347.67766 


< 1 


ABD 


2 


230. 55670 


< 1 


ACD 


2 


2186.79387 


< 1 


BCD 


2 


3824.97604 


< 1 


ABCD 


2 


2441. 78887 


<1 


Subj X D w grps 


136 


5895.15512 




(E2) 








* p . 05 ** 


pCOl 








140 
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Table EE 

Summary Table for the Analysis of Variance of Scores on the 
Audi tory— Vocal Automatic Subtest of the ITPA (1961 Version) 
for Males and Females, from Two Schools, under Two Treatments, 

over Three Years of Testing 



Source 



df 



MS 



F 



Total 



227 



Between 


75 


Treatment (A) 


1 


School (B) 


1 


Sex (B) 


1 


AB 


1 


AC 


1 


BC 


1 


ABC 


1 


Subj w grps (El) 


68 


Within 


152 


Years (D) 


2 


Subj X D 


150 


AD 


2 


BD 


2 


CD 


2 


ABD 


2 


ACD 


2 


BCD 


2 


ABCD 


2 


Subj X D w grps 
(E2) 


136 



166971.02268 5.27* 

189016.75922 5-98* 

28820.55753 <1 

5365.71115 <1 

1229.10856 <1 

7016.08696 <1 

6165.79699 ■'-I 



31602.30773 



93858.91072 



7-19 ** 



9015.50802 <1 

2290.89795 <1 

13795.23980 2-25 

9 697.63751 <1 

7135.59891 1-16 

3936.99793 <1 

8925.20770 1.95 



6190.99905 



* p . 05 ** p< - 01 







Ml 
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Table FF 

Summary Table for the Analysis of Variance of Scores on the 
Auditory-Vocal Sequential Subtest of the ITPA (1961 Version) 
for Males and Females from Two Schools, under Two Treatments, 

over Three Years of Testing 





Source 




df 




MS 


F 




Total 




227 










Between 




75 










Treatment 


(A) 


1 




3608M.M4576 


1 




School (B) 




1 




16666-86718 


1 




Sex (C) 




1 




33255-77671 


1 




AB 




1 




43-72363 


1 




AC 




1 




5159-89885 


1 




BC 




1 




9640-27022 


1 




ABC 




1 




45613-74877 


1.17 




Subj w grp 


(El) 


68 




38966-26887 






Within 




152 










D 




2 




306-72868 


1 




Sub j X D 




150 










AD 




2 




3981.52910 


1.07 




BD 




2 




7095.95784 


1. 91 




CD 




2 




1980. 03771 


1 




ABD 




2 




1662-79903 


1 




ACD 




2 




228.05675 


1 




BCD 




2 




1776.59782 


1 




ABCD 




2 




667.38468 


1 




Subj X D w 


grp 


136 




3717.45081 






(E2) 












o 














ERIC 






: ■ r 


Jf42 







Table GG 



Summary Table for the Analysis of Variance of Scores on the 
Visual-Motor Sequential Subtest of the ITPA C1961 Version) 
for Males and Females from Two Schools, under Two Treatments, 

over Three Years of Testing 



Source 


df 


MS 


F 


Total 


227 






Between 


75 






Treatment (A) 


1 


11383.14422 


1. 20 


School (B) 


1 


1244 . 31234 


1 


Sex (C) 


1 


1276.04641 


- 1 


AB 


1 


26989.11383 


2-84 


AC 


1 


58278.39848 


6.13* 


BC 


1 


5196.83691 


1 


ABC 


1 


11716.91319 


1-23 


Subj w grp (El) 


68 


9510.43729 




Within 


152 






Year (D) 


2 


44317.39663 


10-11** 


Subj X D 


150 






AD 


2 


10708.48908 


2-44 


BD 


2 


6911.39514 


1-58 


CD 


2 


3816.27723 


1 


ABD 


2 


587.00390 


- 1 


ACD 


2 


1633.53940 


-.1 


BCD 


2 


4787.68676 


1-09 


ABCD 


2 


5865.59931 


1- 34 


Subj X D w grps 


136 


4384.62245 





(E2) 



* p 05 ** p <.01 
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Table HH 

Summary Table for the Analysis of Variance of Scores on the 
Vocal Encoding Subtest of the ITPA (1961 Version) for Males 
and Females from Two Schools, under Two Treatments, over 

Three Years of Testing 



Source 


df 


MS 


F 


Total 


227 






Between 


75 






Subject Group (A) 


1 


73828.85898 


5.44* 


School (B) 


1 


2455.87022 


^1 


Sex (C) 


1 


37625.02781 


2.77 


AB 


1 


2587.24520 


^1 


AC 


1 


1458.38978 


<1 


BC 


1 


241. 32180 


<1 


ABC 


1 


14429.15594 


1.06 


Subj w grps (El) 


68 


13572.48535 




Within 


152 






D 


2 


15705.48296 


3.40-^- 


Sub j X D 


150 






AD 




*-i ^u02. 85607 


9. 31** 


BD 


2 


2201.61500 


< 1 


CD 


2 


15177.45760 


3.29* 


ABD 


-D 


11358.27226 


2.46 


ACD 


2 


2436.07469 


^.1 


BCD 




14497.36889 


3.14* 


ABCD 


2 


2860.07149 


< 1 


Subj X D w grps 


136 


4617.97616 





CE2:i 



* p "s; . 05 ** p^.Ol 







144 



35- 



Table II 

Summary Table for the Analysis of Variance of Scores of the 
Motor Encoding Subtest of the ITPA C1961 Version) for Males 
and Females from Two Schools, under Two Treatments, over 

Three Years of Testing 



Source df 

Total 227 

Between 75 

Subject Group (A) 1 

School (B) 1 

Sex CC) 1 

AB 1 

AC 1 

BC 1 

ABC 1 

Subj w grps (El) 68 



Wi th . 



152 



MS 



132817. 
3M908. 
26350. 
31707. 
38M56. 
966. 
938. 
11^ 96. 



09050 

70350 

50390 

69981 

99110 

71579 

20569 

99502 



11.91* 

3.13 

2. 36 
2.89 

3. 95 

<1 

< 1 



Group (D) 

Subj X D 

AD 

BD 

CD 

ABD 

ACD 

BCD 

ABCD 

Subj X D w grps 

(E2) 



2 

150 

2 

2 

2 

2 

2 

2 

2 

136 



59602.93885 


12. 72* 


23015.72233 


9.91* 


9363. 56292 


< 1 


1107.78990 


< 1 


2607.62795 


<1 


188.92986 


< 1 


2896.62787 


< 1 


99-99911 

9686.93322 


<1 



* p 01 




0 f* i 
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Table JJ 



Analysis of Variance of ITPA (1968 Version) 
Scaled Scores for E and Ck Subjects 
First, Second and Third Grades 



Source 


df 


MS 


F 


Subject Group (A) 


1 


115-44 


8 


Grade (B) 


2 


49-48 


3 


AB 


2 


2-86 




W1 thin 


114 


13- 35 





p . 01 ** . 05 





65* 

71** 
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Table KK 

Analysis of Variance of 

Illinois Test of PsychoUnguls tic Abilities: (1968 

Auditory Reception Subtest 



Source df 

Subject Group (A) 1 

Grade (B) 2 

AB 2 

Within im 



MS F 

106.91 2 

6.82 <1 

57.56 1 



92.51 





Version) 



50 



35 
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Table LL 

Analysis of Variance of 

Illinois Te sf of Psycholinguistic Abilities: C1968 Version) 

Visual Reception Subtest 



MS F 

261.07 5.07* 

85.72 1.66 

1 - M 3 U 

51.53 

* p . 0 5 



Source df 

Subject Group (A) 1 

Grade (B) 2 

AB 2 

Within IIM 
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Table MM 



Analysis of Variance of 
Illinois Test of Psycholinguistic Abilities: 

Auditory Association Subtest 



(1968 Version) 



Source 


df 


MS 


F 


Subject Group (A) 


1 


2^6.53 


8 . 38* 


Grade (B) 


2 


160.82 


5.47* 


AB 


2 


46.91 


1. 59 


Within 


IIM 


29 - 40 




Total 


119 







* p > . 01 



O 




imi 
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Table NN 

Analysis of Variance of 

Illinois Test of Psycholinguistic Abilities: (1968 

Visual Association Subtest 



Source 


df 


MS 


F 


Subject Group (A) 


1 


17.63 


>1 


Grade (B) 


2 


78.32 


3 


AB 


2 


33.61 


1 


Within 


114 


21.76 




Total 


119 







p >. 05 





Version) 



60* 

54 
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Table 00 

Analysis of Variance of 

Illinois Test of Psychollnguls tic Abilities; (1968 Version) 

Sound Blend Subtest 



Source df 

Subject Group (A) 1 

Grade (B) 2 

AB 2 

Within im 

Total 119 

* P^-Ol 



MS F 

7M5.01 15-80* 

251.86 5.3M* 

21.76 >1 

M7. 16 




151 
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Table PP 

Analysis of Variance of 

Illinois Test of Psycholingusltlc Sbilltles: (1968 Version) 

Visual Closure Subtest 



Source 


df 


MS 


F 


Subject Group (A) 


1 


2.19 




Grade (B) 


2 


9.86 


>1- 


AB 


2 


23.80 


1 


Wi thin 


119 


23.90 




Total 


119 








152 



Id f 
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Table QQ 

Analysis of Variance of 
Alphabet Name In entory (ANI) 
for E and Ck Subjects by Pretest and F ":test 



Source 


df 


MS 


r* 


Pre and Post (A) 


1 


1.89 


< i. 


Subject Group (B) 


1 


396.63 




AB 


1 


115.23 


- 


Within 


95 


207.92 





91 
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Table RR 

Analysis of Variance of 
Body Parts Name Inventory (BPNI) 
for E and Ck Subjects by Pretest and Postest 



Source 






df 


MS 


F 


Pre and 


Post 


(A) 


1 


1. 69 


<1 


Subject 


Group 


CB) 


1 


63.94 


6.87* 


AB 






1 


24.71 


2 65 


Within 






95 


9.31 





p < . 05 





-M-5- 



Table SS 

Analysis of Variance of 
Numeral Name Inventory (NNI) 
for E and Ck Subje ~'ts by Pretest and Postest 



Source 


df 


MS 


F 


Pre and Post C-^) 


1 


7. 


<T- 


Subject Group (B) 


1 


292.14 


2. 10 


AB 


1 


250.46 


1.80 


Within 


95 


138,95 
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Table TT 

Analysis of Variance of 
Quantity Mr.tching In ventory (QMI) 
for E and Ck Subjects for Pretest and Postest 



Source 


df 


MS 


F 


Pre and Post CA) 


1 


5,45 


<1 


Subject Group CB) 


1 


27,09 


3 


AB 


1 


, 19 


<1 


Within 


9M 


8,68 
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Table UU 

Analysis of Variance of 
Related Concepts In entory-Pre-Ma th (RCI-PM) 
for E and Ck Subjects by Pretest and Postest 



Source 


df 


MS 


F 


Pre and Post (A) 


1 


.19 


<vl 


Subject Group (B) 


1 


38,29 


8. 68* 


AB 


1 


9.80 


2. 22 


Within 


95 


9. Ml 





* p<.01 
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Tgble W 

Analysis of Vartancer of 

Related Concepts Inven tory-Pre-Soience (RCI-PS) 
for E and Ck Subjects by Pretest and Postest 



Source 
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Analysis of Variance of 
Set Matching In entory 
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Table XX 

Analysts of Variance of 
Shape Name In entory (SNI} 
for E and Ck Subjects by Pretest and Postest 
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APPENDIX III: MATH— SCIENCE LOGS 



Logs taken by teachers during the 1967-68 school year yielded 
the following specific information about the IDS mathematics-science 
program, as it had developed to that point. The D.ist is not in- 
tended to be definitive or exhaustive but merely to include the 
essentials of the program: 



PreKindergarten 

Skills and Concepts : 

Rote counting to 10 
Rational counting to 5 
Recognition of numerals 1-5 
Identifying numbers by name 
Sequential ordering of numerals 1-5 

Beginning the concept of set (one-to-ore .correspondence) 
Concepts of size, e.g., long, short; shamie, e.g., tri- 
angle, circle^ one-to-one correspoiv-ience J quantity, 
e.g., whole, more, le.^s 
Polar opposites 
Introduction io measurement 



Materials Used : 

Teacher made materials, e.g., lotto, sorting games 
Daily individual calendar 
Stern manipulative materials 
Number songs, charts, fingerplays 
Concrete materials, e.g., funnels, spoons 
Flannelboard plus objects and pictures 
Montessori materials 
Number puzzles 
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Kindergarten 



Skills and Concepts : 

Recognition of numerals 1-10 
Rote counting to 20 
Rational counting to 10 
Introduction to term "set” 

Matching sets 

Introduced number combinations 1-5 

Simple addition and subtraction with concrete materials 

Ordering of numerals 1-10 

Writing numerals 1-5 

Time: telling the hour 

Calendar: week, month 

Measurement: introduction to cups, points, quarts, etc- 

Concept of before , after , more , less , same as 
Reading a thermometer 

Introduc tin to concept of shapes, e.g., hexagon, triangle, 
diamond, etc. 



Materials Used : 

Teacher-made games, e.g., lotto, bingo. Stern manipulative 
materials, Cuisenaire rods 
Montessori rods 
Concrete materials 
Calendars 

Thermometers, measuring cups, clocks, etc„ 

Shapes, e.g„, diamond, square 

Unifix cubes, pattern boards 

Stacking squares / 



First Grade 

Skills and Concepts : 



Review: concept of sets 

One-to-one correspondence 
Recognito-on and writing of numerals 
Concept of addition 
Addition facts 1-6 
Introduced: 

Commutative property of 
Addition 

Writing equations 
Counting by 2^s, 10^ s, etc. 

Recognition and verbalizing of addition symbols 
Using number line for addition 
Concept of subtraction 
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Recognition and varbalizing of subtra/ction 
Symbols uising number line for subtraction 
Time: 1 hour, half hour 



31aterials Used: 



Houghton-Mifflin Math Series 
Math Lab (supplementary ID)S) 
Mathematical Objectives 
Supplements 
Unifix Cubes 

Stern Manipulate 'e materials 
Individual nmr.be:'’ lines 
Teacher-iriade mat ’rials 
Commercial games 
Number Pole 
Language Master 
Science - a pro.- ess approach 
Cuisenaire rods 



Second Grade 



Concepts and Skills : 

Reviewed : concept of sets 
Number concepts 1-10 
Addition and subtraction 1-10 
What ’'equal" means 
Introduced : 

Concept of set as it relates to multiplication, place 
value, coliamn addition and subtraction, changing 
in addition, simple multiplication 
Time: Review 1 hour, half hour 

Money: make change, solve problems 

Measurement : 

Introduced: ruler, pints, quarts, etc„ 

Fractions: 1/M-, 1/3, 1/8 

Concept of adding and multiplying fractional parts 
(one class) 

Roman numerals I-XII (one class) 



Materials Used: 



Math Lab 

IDS mathematical objectives 
Houghton-Mifflin series 
Stern Series 

Teacher-made games and materials 



O 
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One- child iriE.de games 
Stern Manipulative Materials 
Cuisenaire Rods 
Uni fix Cube 

Science - A. Prx.cess Approach 

Listening Cenrer?, e.g., tape - How Big is Big 
Snack Program - soma teachers have used this as part of 
the regular math program to provide additional con- 
crete experiences. 



Th: rd Grade 



Concepts and Skills : 

Reviewed ; number facts (slow group) 

Simple multiplication and division 

Place value 

Exchange in addition and subtraction 

Application of addition and subtraction toward problems 
and practical situations 

Introduce: complex multiplication and division operations, 

mixed operations 

Application toward problems and practical situations, 
work with fractions and graphs 



Materials Used : 

Same as Second Grade 
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APPE?C‘I" IV: STAFF LISTING 



CurriQuJ-Ujn Social Sarvlo^, 
and Tralnans: 



Abrahair . Tluth 
Alerxande : , Adeline 
AlsTran.. -ranees 
Andre^ws, Phyllis 
Bahadu:::', Dorethea 
Bangsgaard, Sandra 
Barnett, Edna 
Bernier, Barbara 
Billups, James 
Blumsteir., Rebecca 
Bodden, Sdna 
Bowler, Lawrence 
Calhoun, Edith 
Cannaday, Jonnie 
Carter, George 
Cato, Alline 
Cato, Sandra 
Church, Alexandria 
Clarke, Naomi 
Clibansky, Freya 
Collier, Lucy 
Council, Karolyn 
Craig, Darlene 
Danavall, Elaine 
David, Barbara 
Diamond, Esta 
Diamond. Julie 
Drager, Thomas 
Drew, Helen 
Ehren, Joan 
Ellis, Laura 
Embree , Suzanne 
Feeley, Dianne 
Feeley, Gillian 
Fondiller, Fay 
Gaynor, Susan 
Fisher, Andre 
Click, Charlotte 
Gravel, Douglas 
Gravel, Maria 
Gropp, Jane 
Gwathmey , Emily 
Halpin, Martha 
Harrison, Frederick 
Heyward, Lolita 
Higgs, Sylvia 
Hirsch, Susan 
Holtzman, Emily 
Holtzman, Harriet 



Hosansky, Roberta 
Howells, Polly 
Ilson, William 
Jackson, Annette 
Jackson, Jacquelyn 
Jackson, Joslyn 
Jacobson, Jill 
Jenkins, Odessa 
Kelly, Carolyn 
Lacey, Diane 
Lefevre, Gail 
Liebowitz, Gail 
Lloyd, Jean 
Loughlin, Rita 
Mag id, Joan 
Margolin, Barbara 
McCluskey, Barbara 
McKay, Amabel 
Meyers , Edwina 
Obey, Cheryl 
Padva, Michael 
Pasamanick, Judith 
Philbrick, Sharon 
Phillips , Laurie 
Ponder, Edward 
Raymond, Monica 
Robins, Clarence 
Saxe, Caroline 
Scott, Rochelle, 
Spiegel, Jeffrey 
Spruill, JoAnna 
Sternberg, Birgitta 
Steinberg, Marion 
Stevens , Mary 
Stuchin, Jacquelyn 
Thaler, Helen 
Thomas , Betsy 
Turner, Miles 
Tynes, Jacquelyn 
Wedderburn, Janette 
Wilson, Barbara 
Winzelberg, Joan 
Yellin, Judith 
Haynes , Elna 
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?EtTOIX IV (continued) 



Research and Ev.a! . ' rion 



Barry, Linda 
Bartosh, Karen 
Beltran, Maria- ~e_; 
Binder, David 
Blin, Karla 
Brovm, Bert 
Caudle, Fair fid 
Chesler, Phyllis 
Cohen, Barbara 
Coleman, Richard 
Collar, Alan 
Cossis, Calliope 
Cutler, Rhoda 
Dalton, Sandra 
Deutsch, Cynthia 
Dill, John 
Feldmann, Shirley 
Friedmein, Helene 
Goldstein, Leo 
Gorrell, Judith 
Gotkin, Lassar 
Gottfried, Marvin 
Hackett, Elizabeth 
Heilman, Marsha 
Jimenez, Dolores 
Kaley, Maureen 
Karp, Barry 
Kreuzer, Judith 
Kupper smith, Judith 
Lombardi, Karen 
Maliver, Alma 
McMartin, James 
Mechanek, Ruth 
Miller, Theresa 
Millman, Susan 
Neuberger, Meyer 
Peisach, Estelle 
•Pollack, Barry 
Richardson, Ellis 
Sasso, Joanna 
Schmidt, Dorothy 
Schneider, Paul 
Schwartz, Judy 
Sher, Abigail 
Silverstein, Sophie 
Soloman, Linda 
Stein, Lana 
Taleporos , Elizabeth 
Schumer, Florencs' 



Tehan, Sarah 
Tilis, Howard 
Victor, Jack 
We in, Norman 
Whelan, Janet 
Wich, Barbara 
Zawel, Daniel 
Eaigao, Bataan 

Administration 



Boulware, Fay 
Covert, Angela 
Ellis, Richard 
Har.iburger, Samuel 
Montgomery, Dargan 



Consultants 



Almy , Millie 
Beilin, Harry 
Fleiss, Bernice 
John, Vera 
Kaplan, Jerome 
Katz, Phyllis 
Knisely, Sally 
Lesser, Anna 
MeSweeney. Joseph 
Shaw, Ann 
Weiner, Max 
Whiteman, Martin 
Wilensky, Harold 
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AFPENDIX IV (continued) 



Secretarial and Clerical 



Adeet), Karen 
Alexander, Judith 
Anderson, Phyllis 
Arruebarrena, Marilyn 
Bender, Norval 
Bondarin, Arley 
Bradford, Lawrence 
Breland, Leslie 
Bright, Evelyn 
Caylor, Ruth 
Campbell, Lil 
Clement, Ruth 
Cobbs, Robert 
Coleman, Ricky 
Cynoe, Winston 
Dawson, Millanese 
DeFord, Cecelia 
Devinne, Phyllis 
Drayton, Patricia 
Driver , Phy 11 is 
Finkelstein, Rochelle 
Fiorello, Barbara 
Fiorello, Josephine 
Fowler, Charles 
Frazier, Rupert 
Gebo, Ann 
Gilliam, Willie 
Goodwin, Brian 
Graves, Annette 
Greenblatt, Ira 
Gregory, Alan 
Gully, Catherine 
Haith, William 
Herring, Alfred 
Hinds, Burmadine 
Hurwitz, Lynda 
Isa, Salima 
Jackson, Cynthia 
Jones , Templeton 
Joyce, Michael 
Kerr, Carol 
Kirkland, Linda 
Koinis, Mary Ellen 
Leggett, Joanne 
Leo, Diana 
Lerman, Paulette 
Linder, Esther 



Lort, Emily 
Madison, Linda 
Mouser, Janina 
Monks, Charlotte 
Murga, George 
Orleans, Lila 
Ortiz, Elsie 
Payne, Marjorie 
Rabinowitz, Cynthia 
Rae, Irene 
Robertson, James 
Robinson, Mary Ann 
Sansalone, Frances 
Santiago, Elsie 
Simmons, Bert 
Smith, Juanita 
Stanwood, Caroline 
Stewart, Carolyn 
Strauss, Carolyn 
Taylor, Redessa 
Tiska, Joan 
Underwood, Margaret 
Walker, James 
Walton, -Fischler, Shirley 
Warren, Pauline 
We in, Carol 
Weng, Charles 
Westerfield, Priscilla 
Wittner, Marjorie 
Zalamea, Eduardo 
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